00000001:02000400:2.0F:1788940350.109909:0:3303:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788940372.998546:0:3523:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788940375.512902:0:3585:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 571 MB/s 00000001:01000000:3.0:1788940375.762345:0:3585:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 559 MB/s 00000001:01000000:2.0:1788940376.012321:0:3585:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3703 MB/s 00000020:02000000:1.0F:1788940376.972342:0:3614:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g930488d 00000400:02000000:1.0:1788940378.005914:0:3629:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.125@tcp [8/256/0/180] 00008000:02000000:2.0:1788940382.244676:0:3778:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788940451.089928:0:5747:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788940466.020978:0:6497:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788940466.020985:0:6497:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788940466.020986:0:6497:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788940466.021128:0:6497:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000009fd49421 00000080:02000400:0.0:1788940466.023430:0:6497:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788940466.052833:0:6497:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788940466.052848:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788940466.055891:0:6497:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a522c120) 00000020:00000080:0.0:1788940466.055927:0:6497:0:(obd_config.c:786:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788940466.227382:0:6497:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788940466.231029:0:6497:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1788940466.315414:0:6497:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788940466.318208:0:6497:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788940466.318220:0:6497:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788940466.318234:0:6497:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08badcc38 00000020:01000004:1.0:1788940466.318241:0:6497:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788940466.318246:0:6497:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788940466.318252:0:6497:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009fd49421 from MGS 00000020:01000004:1.0:1788940466.318499:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788940466.326437:0:6497:0:(genops.c:415:class_newdev()) Allocate new device MGS (0000000056e94220) 00000020:00000080:2.0:1788940466.326475:0:6497:0:(obd_config.c:786:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788940466.329656:0:6497:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009fd49421 from MGS, refs=2 00080000:01000000:2.0:1788940466.329674:0:6497:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788940466.329686:0:6497:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08badcc46 00000100:00100000:2.0:1788940466.329847:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788940466.330004:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788940466.330010:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788940466.346460:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788940466.346482:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788940466.349098:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940466.354578:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788940466.354661:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788940466.358982:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788940466.359000:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788940466.360210:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788940466.360222:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788940466.362762:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940466.362767:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940466.362769:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940466.364762:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940466.364767:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940466.364769:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940466.368972:0:6497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788940466.381398:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788940466.631053:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 919 MB/s 00000001:01000000:2.0:1788940466.883433:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1126 MB/s 00000001:01000000:0.0:1788940467.134161:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 231 MB/s 00000001:01000000:3.0:1788940467.383850:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 351 MB/s 00080000:10000000:3.0:1788940467.417818:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:1.0:1788940467.422335:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788940467.433916:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788940467.439350:0:6497:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788940467.439427:0:6497:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788940467.439698:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788940467.439720:0:6497:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788940467.440044:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940467.440413:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788940467.440419:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 10000000:01000000:3.0:1788940467.440576:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 00000100:00100000:1.0:1788940467.444065:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788940467.444077:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788940467.463043:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788940467.463086:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788940467.464650:0:6497:0:(obd_config.c:900:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788940467.464674:0:6497:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.125@tcp' 00000020:01000004:3.0:1788940467.464677:0:6497:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788940467.464736:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.125@tcp (typ=mgc) 00000020:00000080:3.0:1788940467.464755:0:6497:0:(genops.c:415:class_newdev()) Allocate new device MGC192.168.202.125@tcp (00000000d7f1fa67) 00000020:00000080:3.0:1788940467.464772:0:6497:0:(obd_config.c:786:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788940467.464859:0:6497:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000461b4239@MGC192.168.202.125@tcp: add connection 192.168.202.125@tcp at head 00010000:00010000:3.0:1788940467.465017:0:6497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.125@tcp-0 is initialized 00000040:01000000:3.0:1788940467.465025:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788940467.465925:0:6516:0:(pinger.c:501:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788940467.478836:0:6517:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788940467.480374:0:6497:0:(obd_config.c:900:class_setup()) finished setup of obd MGC192.168.202.125@tcp (uuid bf4e294e-c65c-4988-a227-6e2e705a91d9) 00000020:00000080:3.0:1788940467.480685:0:6497:0:(genops.c:1393:class_connect()) connect: client bf4e294e-c65c-4988-a227-6e2e705a91d9, cookie 0x9c34acc08badcc54 00000100:00080000:3.0:1788940467.480699:0:6497:0:(import.c:545:import_select_connection()) MGC192.168.202.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788940467.480705:0:6497:0:(import.c:665:import_select_connection()) MGC192.168.202.125@tcp: import 00000000461b4239 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940467.480758:0:6497:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000ca68bf3 x1875839944753280/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788940467.480791:0:6497:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import bf4e294e-c65c-4988-a227-6e2e705a91d9->MGS 00000020:01000004:3.0:1788940467.480860:0:6497:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788940467.480872:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788940467.480887:0:6497:0:(genops.c:415:class_newdev()) Allocate new device MDS (000000005da9f0f8) 00000020:00000080:3.0:1788940467.480899:0:6497:0:(obd_config.c:786:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788940467.481836:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ca68bf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf4e294e-c65c-4988-a227-6e2e705a91d9:3644:1875839944753280:0@lo:250: 00000100:00100000:0.0:1788940467.481911:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940467.481984:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944753280 00000100:00100000:0.0:1788940467.481992:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944753280 00000100:00100000:0.0:1788940467.487735:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940467.487746:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0b78cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1875839944753280:12345-0@lo:250: 00010000:00080000:0.0:1788940467.487775:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from bf4e294e-c65c-4988-a227-6e2e705a91d9@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:0.0:1788940467.487801:0:6512:0:(genops.c:1393:class_connect()) connect: client bf4e294e-c65c-4988-a227-6e2e705a91d9, cookie 0x9c34acc08badcc62 00000100:00080000:0.0:1788940467.487943:0:6512:0:(import.c:65:import_set_state_nolock()) 0000000027333f45 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940467.488020:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0b78cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+5:3644:x1875839944753280:12345-0@lo:250: Request processed in 274us (6108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940467.488029:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940467.488092:0:3644:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788940467.488101:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.125@tcp: connect to target with instance 0 00000100:00080000:0.0:1788940467.489033:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788940467.489039:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788940467.489042:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000461b4239 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788940467.489045:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788940467.494861:0:3644:0:(pinger.c:187:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788940467.494879:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ca68bf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf4e294e-c65c-4988-a227-6e2e705a91d9:3644:1875839944753280:0@lo:250: 00000100:00100000:2.0:1788940467.506665:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940467.507597:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788940467.507606:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788940467.511380:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788940467.511394:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788940467.512673:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788940467.512682:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788940467.513796:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940467.514092:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788940467.514098:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788940467.514878:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788940467.514885:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788940467.568004:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940467.568928:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788940467.568936:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788940467.571383:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788940467.571398:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788940467.573674:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940467.573956:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788940467.573962:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788940467.582325:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788940467.582344:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788940467.583167:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940467.583435:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788940467.583440:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788940467.585450:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788940467.585461:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788940467.586375:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940467.586615:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788940467.586629:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788940467.587358:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788940467.587365:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788940467.629032:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940467.629397:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788940467.629461:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788940467.634051:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788940467.634064:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788940467.636528:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788940467.636549:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788940467.637419:0:6497:0:(obd_config.c:900:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788940467.637444:0:6497:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788940467.637449:0:6497:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788940467.637603:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788940467.637635:0:6497:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.125@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788940467.637639:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788940467.637640:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788940467.637641:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940467.637642:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940467.637643:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940467.637644:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940467.637645:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940467.637646:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788940467.637647:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940467.637648:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940467.637648:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940467.637649:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940467.637651:0:6497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788940467.637652:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940467.637653:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788940467.637653:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940467.637654:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940467.637654:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940467.637655:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940467.637656:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940467.637656:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788940467.637657:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940467.637657:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940467.637658:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940467.637659:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940467.637686:0:6497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788940467.637716:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000021f9f31 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944753408:0@lo:253: 00000100:00100000:2.0:1788940467.637792:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940467.637840:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db87a8f1 going to sleep for 11 seconds 00000100:00100000:3.0:1788940467.638204:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944753408 00000100:00100000:3.0:1788940467.638211:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944753408 00000100:00100000:3.0:1788940467.638245:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940467.638253:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099f9aa1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+5:6497:x1875839944753408:12345-0@lo:253: 20000000:01000000:3.0:1788940467.638448:0:6515:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788940467.638451:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788940467.638794:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788940467.638851:0:6515:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788940467.639572:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788940467.640780:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788940467.641073:0:6515:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788940467.641081:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788940467.641087:0:6515:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788940467.641090:0:6515:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788940467.641100:0:6515:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788940467.641443:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940467.641594:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788940467.641608:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788940467.641624:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788940467.641639:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788940467.641652:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788940467.641786:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788940467.641795:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788940467.641821:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788940467.641828:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788940467.641841:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788940467.641846:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788940467.641857:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788940467.641869:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788940467.641898:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788940467.641903:0:6515:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788940467.641909:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940467.642068:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788940467.642078:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788940467.642091:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788940467.642101:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788940467.642114:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788940467.642122:0:6515:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788940467.642147:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788940467.642154:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788940467.642167:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788940467.642182:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788940467.642197:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788940467.642213:0:6515:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788940467.642238:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788940467.642245:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788940467.642419:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788940467.642441:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788940467.642503:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788940467.642525:0:6515:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788940467.642532:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788940467.642830:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788940467.643085:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788940467.643102:0:6515:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.125@tcp for mdt 20000000:01000000:1.0:1788940467.643103:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:1.0:1788940467.643124:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788940467.643129:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788940467.643138:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788940467.643142:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:1.0:1788940467.643151:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788940467.643156:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788940467.643164:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788940467.643174:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788940467.643198:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788940467.643201:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788940467.643204:0:6515:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788940467.644280:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788940467.644284:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788940467.644602:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788940467.644769:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788940467.644788:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788940467.644798:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1788940467.644806:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788940467.644808:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788940467.645168:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788940467.645370:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788940467.645390:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788940467.645554:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1788940467.645568:0:6515:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788940467.645570:0:6515:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788940467.645574:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788940467.645576:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788940467.645580:0:6515:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788940467.645585:0:6515:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788940467.645921:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788940467.648466:0:6515:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788940467.657769:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788940467.657811:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788940467.657829:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788940467.657982:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788940467.658006:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc69 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940467.658023:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc69 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940467.658033:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc69 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940467.658040:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc69 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940467.658047:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc69 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940467.658054:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc69 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940467.658061:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a0c5de69 already unused, calling callback (000000007b9d4142) 00010000:00010000:1.0:1788940467.658076:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc69 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940467.658084:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc69 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940467.658097:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc69 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940467.658104:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc69 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940467.658110:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc69 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788940467.658132:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788940467.677211:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099f9aa1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+5:6497:x1875839944753408:12345-0@lo:253: Request processed in 38937us (39398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940467.677230:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940467.682075:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000021f9f31 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944753408:0@lo:253: 10000000:01000000:2.0:1788940467.682097:0:6497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788940467.682100:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788940467.682102:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788940467.682103:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940467.682104:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788940467.682105:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940467.682106:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940467.682108:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940467.682109:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788940467.682110:0:6497:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788940467.682111:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940467.682113:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788940467.684951:0:6497:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009fd49421 from lustre-MDT0000 10000000:01000000:3.0:1788940467.685062:0:6497:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788940467.685066:0:6497:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788940467.685070:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91d00509b3b0 10000000:01000000:3.0:1788940467.685074:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788940467.685082:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91d00509b3b0 from 1 10000000:01000000:3.0:1788940467.685085:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788940467.685127:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badcc70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940467.685138:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badcc70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940467.685148:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badcc70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940467.685171:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944753536:0@lo:101: 00000100:00100000:3.0:1788940467.686096:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940467.686232:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b59753e4 going to sleep for 11 seconds 00000100:00100000:0.0:1788940467.689623:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944753536 00000100:00100000:0.0:1788940467.689641:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944753536 00000100:00100000:0.0:1788940467.690041:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940467.690053:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016292948 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+5:6497:x1875839944753536:12345-0@lo:101: 00010000:00010000:0.0:1788940467.690071:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940467.690091:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000010be789b/0x9c34acc08badcc77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcc70 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940467.690117:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010be789b/0x9c34acc08badcc77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcc70 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940467.690144:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000010be789b/0x9c34acc08badcc77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcc70 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940467.690152:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000010be789b, rc 0) 00000100:00100000:0.0:1788940467.690319:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016292948 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+6:6497:x1875839944753536:12345-0@lo:101: Request processed in 269us (4225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940467.690326:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940467.690532:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944753536:0@lo:101: 00010000:00010000:3.0:1788940467.690560:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badcc70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcc77 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940467.690569:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badcc70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcc77 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940467.690657:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944753664:0@lo:501: 00000100:00100000:3.0:1788940467.691179:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940467.691235:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b59753e4 going to sleep for 11 seconds 00000100:00100000:1.0:1788940467.691360:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944753664 00000100:00100000:1.0:1788940467.691367:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944753664 00000100:00100000:1.0:1788940467.691421:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788940467.691430:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071547716 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+6:6497:x1875839944753664:12345-0@lo:501: 00000100:00100000:1.0:1788940467.691518:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071547716 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+6:6497:x1875839944753664:12345-0@lo:501: Request processed in 90us (339us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788940467.691525:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940467.691634:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944753664:0@lo:501: 10000000:01000000:3.0:1788940467.691664:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788940467.691680:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badcc70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcc77 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940467.692014:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badcc70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcc77 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940467.692027:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91d004f4a000 10000000:01000000:3.0:1788940467.692032:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788940467.692037:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91d004f4a000 10000000:01000000:3.0:1788940467.692040:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788940467.692043:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91d004f4a000 from 1 10000000:01000000:3.0:1788940467.692046:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788940467.692070:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 000000007cf6f644/0x9c34acc08badcc7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940467.692077:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 000000007cf6f644/0x9c34acc08badcc7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940467.692097:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 000000007cf6f644/0x9c34acc08badcc7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940467.692113:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944753792:0@lo:101: 00000100:00100000:3.0:1788940467.692143:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940467.692165:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b59753e4 going to sleep for 11 seconds 00000100:00100000:0.0:1788940467.692225:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944753792 00000100:00100000:0.0:1788940467.692230:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944753792 00000100:00100000:0.0:1788940467.692280:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940467.692296:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d1e292 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+6:6497:x1875839944753792:12345-0@lo:101: 00010000:00010000:0.0:1788940467.692306:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940467.692317:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b15cdb8b/0x9c34acc08badcc85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcc7e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940467.692333:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b15cdb8b/0x9c34acc08badcc85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcc7e expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940467.692341:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b15cdb8b/0x9c34acc08badcc85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcc7e expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940467.692348:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b15cdb8b, rc 0) 00000100:00100000:0.0:1788940467.692385:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d1e292 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+7:6497:x1875839944753792:12345-0@lo:101: Request processed in 99us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940467.692392:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940467.692465:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944753792:0@lo:101: 00010000:00010000:3.0:1788940467.692475:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 000000007cf6f644/0x9c34acc08badcc7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcc85 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940467.692482:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 000000007cf6f644/0x9c34acc08badcc7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcc85 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940467.692492:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788940467.692505:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 000000007cf6f644/0x9c34acc08badcc7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcc85 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940467.692511:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 000000007cf6f644/0x9c34acc08badcc7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcc85 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940467.692517:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788940467.692521:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788940467.692525:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91d004f4a000 10000000:01000000:3.0:1788940467.692528:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788940467.692531:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788940467.692533:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788940467.692545:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badcc8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940467.692558:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badcc8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940467.692564:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badcc8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940467.692575:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944753920:0@lo:101: 00000100:00100000:3.0:1788940467.692600:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940467.692627:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b59753e4 going to sleep for 11 seconds 00000100:00100000:1.0:1788940467.692798:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944753920 00000100:00100000:1.0:1788940467.692803:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944753920 00000100:00100000:1.0:1788940467.692836:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940467.692842:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f859579 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+7:6497:x1875839944753920:12345-0@lo:101: 00010000:00010000:1.0:1788940467.692958:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940467.692967:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcc8c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940467.692981:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcc8c expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940467.692989:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcc8c expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940467.692995:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a0c5de69, rc 0) 00000100:00100000:1.0:1788940467.693033:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f859579 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+8:6497:x1875839944753920:12345-0@lo:101: Request processed in 192us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940467.693039:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940467.693233:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944753920:0@lo:101: 00010000:00010000:3.0:1788940467.693243:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badcc8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcc93 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940467.693251:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badcc8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcc93 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940467.693350:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944754048:0@lo:501: 00000100:00100000:3.0:1788940467.693373:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940467.693398:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b59753e4 going to sleep for 11 seconds 00000100:00100000:2.0:1788940467.693462:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944754048 00000100:00100000:2.0:1788940467.693467:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944754048 00000100:00100000:2.0:1788940467.693497:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940467.693503:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002442e898 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+8:6497:x1875839944754048:12345-0@lo:501: 00000100:00100000:2.0:1788940467.693618:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002442e898 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+9:6497:x1875839944754048:12345-0@lo:501: Request processed in 115us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940467.693625:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940467.694147:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944754048:0@lo:501: 00000100:00100000:3.0:1788940467.694175:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944754176:0@lo:503: 00000100:00100000:3.0:1788940467.694215:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940467.694236:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b59753e4 going to sleep for 11 seconds 00000100:00100000:0.0:1788940467.694298:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944754176 00000100:00100000:0.0:1788940467.694304:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944754176 00000100:00100000:0.0:1788940467.694336:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788940467.694348:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4cf5c75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+9:6497:x1875839944754176:12345-0@lo:503: 00000100:00100000:0.0:1788940467.694434:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4cf5c75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+9:6497:x1875839944754176:12345-0@lo:503: Request processed in 86us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940467.694441:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940467.694933:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944754176:0@lo:503: 00000100:00100000:3.0:1788940467.696463:0:6542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:6542:1875839944754304:0@lo:502: 00000100:00100000:3.0:1788940467.696537:0:6542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940467.696606:0:6542:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003486035 going to sleep for 11 seconds 00000100:00100000:1.0:1788940467.696647:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944754304 00000100:00100000:1.0:1788940467.696655:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944754304 00000100:00100000:1.0:1788940467.696950:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940467.696960:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006043da1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+9:6542:x1875839944754304:12345-0@lo:502: 00000100:00100000:1.0:1788940467.697081:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006043da1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+9:6542:x1875839944754304:12345-0@lo:502: Request processed in 121us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940467.697090:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788940467.697168:0:6542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:6542:1875839944754304:0@lo:502: 00000020:01000000:3.0:1788940467.697193:0:6542:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940467.697213:0:6542:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940467.697215:0:6542:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788940467.697219:0:6542:0:(obd_config.c:2066:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788940467.697222:0:6542:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788940467.697236:0:6542:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000006024a0ec) 00000020:00000080:3.0:1788940467.697253:0:6542:0:(obd_config.c:786:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788940467.697293:0:6542:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788940467.697381:0:6542:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788940467.697388:0:6542:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08badcca1 00000020:00000080:3.0:1788940467.697611:0:6542:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788940467.697615:0:6542:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940467.697618:0:6542:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940467.697620:0:6542:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788940467.697622:0:6542:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940467.697625:0:6542:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940467.697627:0:6542:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788940467.697630:0:6542:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788940467.697636:0:6542:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000 (00000000999573c9) 00000020:00000080:3.0:1788940467.697646:0:6542:0:(obd_config.c:786:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788940467.697649:0:6542:0:(obd_config.c:1571:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788940467.697651:0:6542:0:(obd_config.c:1615:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788940467.697653:0:6542:0:(obd_config.c:1248:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788940467.697659:0:6542:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788940467.697733:0:6542:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009fd49421 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788940467.697754:0:6542:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDD0000 (000000007d2cd8f1) 00000020:00000080:3.0:1788940467.697762:0:6542:0:(obd_config.c:786:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788940467.697815:0:6542:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788940467.697823:0:6542:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08badccb6 00000020:00000080:3.0:1788940467.697942:0:6542:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788940467.697948:0:6542:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788940467.697953:0:6542:0:(genops.c:1393:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9c34acc08badccbd 00080000:01000000:3.0:1788940467.697958:0:6542:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788940467.697960:0:6542:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08badccc4 00080000:10000000:3.0:1788940467.698418:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788940467.698571:0:6542:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788940467.708169:0:6542:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788940467.879465:0:6542:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788940467.880078:0:6542:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788940467.895301:0:6542:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788940467.895691:0:6542:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788940467.905174:0:6542:0:(genops.c:415:class_newdev()) Allocate new device lustre-QMT0000 (00000000d5d5de0f) 00000020:00000080:3.0:1788940467.912147:0:6542:0:(obd_config.c:786:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788940467.913866:0:6542:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788940467.913900:0:6542:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08badccd2 00000020:00000080:3.0:1788940467.927338:0:6542:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788940467.936100:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1788940467.950683:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1788940467.956945:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1788940467.963623:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1788940467.991038:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1788940468.026674:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1788940468.032794:0:6542:0:(genops.c:1393:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9c34acc08badccd9 00000020:00000080:2.0:1788940468.034634:0:6542:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788940468.034648:0:6542:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940468.034656:0:6542:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940468.034658:0:6542:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788940468.034661:0:6542:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940468.034690:0:6542:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940468.034692:0:6542:0:(obd_config.c:1662:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788940468.034702:0:6542:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788940468.034704:0:6542:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788940468.034706:0:6542:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940468.034708:0:6542:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940468.034709:0:6542:0:(obd_config.c:1662:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788940468.034711:0:6542:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940468.034715:0:6542:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940468.034716:0:6542:0:(obd_config.c:1662:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788940468.034720:0:6542:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788940468.034782:0:6542:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788940468.034840:0:6542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000021f9f31 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:6542:1875839944754432:0@lo:502: 00000100:00100000:2.0:1788940468.034911:0:6542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940468.034966:0:6542:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cea59335 going to sleep for 11 seconds 00000100:00100000:0.0:1788940468.035083:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944754432 00000100:00100000:0.0:1788940468.035092:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944754432 00000100:00100000:0.0:1788940468.035138:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788940468.035146:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000282162b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+9:6542:x1875839944754432:12345-0@lo:502: 00000100:00100000:0.0:1788940468.035277:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000282162b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+9:6542:x1875839944754432:12345-0@lo:502: Request processed in 111us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940468.035294:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940468.035597:0:6542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000021f9f31 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:6542:1875839944754432:0@lo:502: 00000020:01000000:2.0:1788940468.035852:0:6542:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940468.035858:0:6542:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940468.035860:0:6542:0:(obd_config.c:1662:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788940468.035864:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788940468.039548:0:6497:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788940468.039582:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788940468.039653:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badcc8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcc93 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940468.039667:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badcc8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcc93 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940468.039887:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d004f4a000 from 1 10000000:01000000:1.0:1788940468.039892:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788940468.039952:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcce0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940468.039960:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcce0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940468.039976:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcce0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940468.039998:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd5e36d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944754560:0@lo:101: 00000100:00100000:1.0:1788940468.040059:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940468.040099:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 000000009dd4a838 going to sleep for 11 seconds 00000100:00100000:3.0:1788940468.040102:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944754560 00000100:00100000:3.0:1788940468.040111:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944754560 00000100:00100000:3.0:1788940468.040242:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788940468.040249:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074c57aa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+9:6497:x1875839944754560:12345-0@lo:101: 00010000:00010000:3.0:1788940468.040295:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940468.040308:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ca49046/0x9c34acc08badcce7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcce0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940468.040329:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ca49046/0x9c34acc08badcce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcce0 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940468.040338:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ca49046/0x9c34acc08badcce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcce0 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940468.040345:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ca49046, rc 0) 00000100:00100000:3.0:1788940468.040382:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074c57aa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+10:6497:x1875839944754560:12345-0@lo:101: Request processed in 133us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940468.040399:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788940468.041534:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd5e36d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944754560:0@lo:101: 00010000:00010000:1.0:1788940468.041555:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcce0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcce7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940468.041565:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcce0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcce7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940468.042101:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd5e36d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944754688:0@lo:256: 00000100:00100000:1.0:1788940468.042151:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940468.042192:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 000000009dd4a838 going to sleep for 11 seconds 00000100:00100000:3.0:1788940468.043496:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944754688 00000100:00100000:3.0:1788940468.043509:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944754688 00000100:00100000:3.0:1788940468.043553:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788940468.043562:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085b281b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+10:6497:x1875839944754688:12345-0@lo:256: 20000000:01000000:3.0:1788940468.043583:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788940468.043588:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788940468.043704:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085b281b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+10:6497:x1875839944754688:12345-0@lo:256: Request processed in 143us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940468.043712:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788940468.044238:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd5e36d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944754688:0@lo:256: 10000000:01000000:1.0:1788940468.045875:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788940468.054329:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcce0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcce7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940468.054356:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcce7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940468.054514:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d004f4a000 from 1 10000000:01000000:0.0:1788940468.054518:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788940468.054579:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000e206da54/0x9c34acc08badccee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940468.054597:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000e206da54/0x9c34acc08badccee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940468.054608:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000e206da54/0x9c34acc08badccee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940468.054640:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbd97f86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944754816:0@lo:101: 00000100:00100000:0.0:1788940468.054722:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940468.054769:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055d4c3cf going to sleep for 11 seconds 00000100:00100000:1.0:1788940468.055053:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944754816 00000100:00100000:1.0:1788940468.055062:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944754816 00000100:00100000:1.0:1788940468.056043:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788940468.056051:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022c38c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+10:6497:x1875839944754816:12345-0@lo:101: 00010000:00010000:1.0:1788940468.056066:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940468.056081:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000d281b4a/0x9c34acc08badccf5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badccee expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940468.056105:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000d281b4a/0x9c34acc08badccf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badccee expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940468.056115:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000d281b4a/0x9c34acc08badccf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badccee expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940468.056122:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000d281b4a, rc 0) 00000100:00100000:1.0:1788940468.056176:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022c38c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+11:6497:x1875839944754816:12345-0@lo:101: Request processed in 125us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940468.056182:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940468.057631:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbd97f86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944754816:0@lo:101: 00010000:00010000:0.0:1788940468.057653:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000e206da54/0x9c34acc08badccee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badccf5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940468.057663:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000e206da54/0x9c34acc08badccee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badccf5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940468.057773:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbd97f86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944754944:0@lo:501: 00000100:00100000:0.0:1788940468.057812:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940468.057847:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055d4c3cf going to sleep for 11 seconds 00000100:00100000:2.0:1788940468.057977:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944754944 00000100:00100000:2.0:1788940468.057984:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944754944 00000100:00100000:2.0:1788940468.058024:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788940468.058030:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c986468c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+11:6497:x1875839944754944:12345-0@lo:501: 00000100:00100000:2.0:1788940468.058173:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c986468c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+11:6497:x1875839944754944:12345-0@lo:501: Request processed in 143us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940468.058181:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940468.058573:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbd97f86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944754944:0@lo:501: 00000100:00100000:0.0:1788940468.058598:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbd97f86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944755072:0@lo:503: 00000100:00100000:0.0:1788940468.058644:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940468.058671:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055d4c3cf going to sleep for 11 seconds 00000100:00100000:1.0:1788940468.058861:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944755072 00000100:00100000:1.0:1788940468.058866:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944755072 00000100:00100000:1.0:1788940468.058892:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940468.058897:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa0379e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+11:6497:x1875839944755072:12345-0@lo:503: 00000040:00080000:1.0:1788940468.058923:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788940468.058949:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa0379e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+11:6497:x1875839944755072:12345-0@lo:503: Request processed in 53us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940468.058954:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788940468.059016:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbd97f86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944755072:0@lo:503: 00000040:00080000:0.0:1788940468.060789:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788940468.065722:0:6497:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788940468.065758:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940468.065812:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000e206da54/0x9c34acc08badccee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badccf5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940468.065841:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 00000000e206da54/0x9c34acc08badccee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badccf5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940468.066050:0:6497:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788940468.066055:0:6497:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91d004f4a000 10000000:01000000:3.0:1788940468.066059:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91d004f4a000 10000000:01000000:3.0:1788940468.066064:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788940468.066073:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91d004f4a000 from 1 10000000:01000000:3.0:1788940468.066076:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788940468.066236:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badccfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940468.066246:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badccfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940468.066278:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badccfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940468.066313:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944755200:0@lo:101: 00000100:00100000:3.0:1788940468.066391:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940468.066439:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 000000001cad6a84 going to sleep for 11 seconds 00000100:00100000:1.0:1788940468.067242:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944755200 00000100:00100000:1.0:1788940468.067250:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944755200 00000100:00100000:1.0:1788940468.067325:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788940468.067400:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e1a471f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+11:6497:x1875839944755200:12345-0@lo:101: 00010000:00010000:1.0:1788940468.067417:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940468.067443:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b6d46e38/0x9c34acc08badcd03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badccfc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940468.067469:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b6d46e38/0x9c34acc08badcd03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badccfc expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940468.067480:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b6d46e38/0x9c34acc08badcd03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badccfc expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940468.067489:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b6d46e38, rc 0) 00000100:00100000:1.0:1788940468.067957:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e1a471f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:6497:x1875839944755200:12345-0@lo:101: Request processed in 623us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940468.067964:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944755200:0@lo:101: 00000100:00100000:1.0:1788940468.067967:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1788940468.067989:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badccfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcd03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940468.067999:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badccfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcd03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940468.068063:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944755328:0@lo:501: 00000100:00100000:3.0:1788940468.068098:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940468.068998:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 000000001cad6a84 going to sleep for 11 seconds 00000100:00100000:2.0:1788940468.069430:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944755328 00000100:00100000:2.0:1788940468.069440:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944755328 00000100:00100000:2.0:1788940468.069527:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940468.069535:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000573bc2ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:6497:x1875839944755328:12345-0@lo:501: 00000100:00100000:2.0:1788940468.070242:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000573bc2ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:6497:x1875839944755328:12345-0@lo:501: Request processed in 706us (2142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940468.070251:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788940468.070391:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944755328:0@lo:501: 00000100:00100000:3.0:1788940468.070442:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944755456:0@lo:503: 00000100:00100000:3.0:1788940468.070493:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940468.070949:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 000000001cad6a84 going to sleep for 11 seconds 00000100:00100000:1.0:1788940468.071113:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944755456 00000100:00100000:1.0:1788940468.071119:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944755456 00000100:00100000:1.0:1788940468.071153:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788940468.071159:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006852d032 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:6497:x1875839944755456:12345-0@lo:503: 00000100:00100000:3.0:1788940468.071342:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944755456:0@lo:503: 00000100:00100000:1.0:1788940468.071403:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006852d032 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:6497:x1875839944755456:12345-0@lo:503: Request processed in 174us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940468.071413:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788940468.072447:0:6547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:6547:1875839944755584:0@lo:502: 00000100:00100000:3.0:1788940468.072501:0:6547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940468.072539:0:6547:0:(client.c:2716:ptlrpc_set_wait()) set 00000000880855fe going to sleep for 11 seconds 00000100:00100000:1.0:1788940468.072543:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944755584 00000100:00100000:1.0:1788940468.072550:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944755584 00000100:00100000:1.0:1788940468.073460:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788940468.073471:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093d1234f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:6547:x1875839944755584:12345-0@lo:502: 00000100:00100000:1.0:1788940468.073920:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093d1234f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:6547:x1875839944755584:12345-0@lo:502: Request processed in 451us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940468.073929:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940468.074083:0:6547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1864b8a pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:6547:1875839944755584:0@lo:502: 00000020:01000004:2.0:1788940468.074147:0:6547:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788940468.074162:0:6547:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000182d514c) 00000020:00000080:2.0:1788940468.074183:0:6547:0:(obd_config.c:786:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788940468.074596:0:6547:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009fd49421 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788940468.074601:0:6547:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009fd49421 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788940468.074604:0:6547:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009fd49421 4 00010000:00080000:2.0:1788940468.074861:0:6547:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d7184638@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:3.0:1788940468.079228:0:6547:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788940468.079632:0:6547:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788940468.079679:0:6547:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788940468.079691:0:6547:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9c34acc08badcd11 00000100:00080000:3.0:1788940468.079700:0:6547:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788940468.079706:0:6547:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d7184638 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940468.079741:0:6547:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e9d01f25 x1875839944755712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788940468.079774:0:6547:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788940468.079960:0:6547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af435138 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:6547:1875839944755840:0@lo:502: 00000100:00100000:3.0:1788940468.080378:0:6547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940468.080524:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e9d01f25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875839944755712:0@lo:38: 00000100:00100000:2.0:1788940468.080561:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940468.080605:0:6547:0:(client.c:2716:ptlrpc_set_wait()) set 000000006eb1e302 going to sleep for 11 seconds 00000100:00100000:0.0:1788940468.083939:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944755712 00000100:00100000:0.0:1788940468.083953:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944755712 00000100:00100000:0.0:1788940468.083989:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940468.083996:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000021f9f31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875839944755712:12345-0@lo:38: 00000100:00100000:0.0:1788940468.084095:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000021f9f31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875839944755712:12345-0@lo:38: Request processed in 98us (3533us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788940468.084103:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940468.084456:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788940468.084465:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000d7184638 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788940468.084470:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788940468.084473:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e9d01f25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875839944755712:0@lo:38: 00000100:00100000:1.0:1788940468.086883:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944755840 00000100:00100000:1.0:1788940468.086897:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944755840 00000100:00100000:1.0:1788940468.088061:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788940468.088072:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086df0ec9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:6547:x1875839944755840:12345-0@lo:502: 00000100:00100000:1.0:1788940468.088327:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086df0ec9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:6547:x1875839944755840:12345-0@lo:502: Request processed in 258us (7949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940468.088506:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788940468.088825:0:6547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af435138 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:6547:1875839944755840:0@lo:502: 00000040:00080000:2.0:1788940468.088859:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788940468.089532:0:6497:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788940468.089553:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788940468.089571:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badccfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcd03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940468.089595:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badccfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcd03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788940468.089773:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788940468.089776:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788940468.089777:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940468.089779:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940468.089780:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940468.089782:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940468.089783:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788940468.089784:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788940468.089786:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788940468.089787:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788940468.089789:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940468.089790:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788940468.089794:0:6497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788940468.089797:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788940468.089798:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788940468.089799:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940468.089800:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940468.089801:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940468.089803:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940468.089804:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788940468.089805:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788940468.089806:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788940468.089811:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788940468.089812:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940468.089813:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788940468.089835:0:6497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788940468.089851:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd5e36d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944755968:0@lo:253: 00000100:00100000:1.0:1788940468.089898:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940468.089932:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c41f5c9 going to sleep for 11 seconds 00000100:00100000:0.0:1788940468.091823:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944755968 00000100:00100000:0.0:1788940468.091836:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944755968 00000100:00100000:0.0:1788940468.091968:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788940468.091977:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3e7fa73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:6497:x1875839944755968:12345-0@lo:253: 20000000:01000000:0.0:1788940468.092006:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788940468.092019:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788940468.103918:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788940468.103937:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788940468.104047:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788940468.104053:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788940468.104076:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e3f8043a/0x9c34acc08badcd18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940468.104095:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005ca49046/0x9c34acc08badcce7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcce0 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940468.104103:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e3f8043a/0x9c34acc08badcd18 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940468.104142:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005ca49046/0x9c34acc08badcce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badcce0 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940468.104156:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005ca49046/0x9c34acc08badcce7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badcce0 expref: 12 pid: 6515 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940468.104168:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a05d2a7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875839944756096:0@lo:104: 00000100:00100000:2.0:1788940468.104670:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940468.105003:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3e7fa73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:6497:x1875839944755968:12345-0@lo:253: Request processed in 13026us (15103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940468.105015:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788940468.105079:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944756096 00000100:00100000:3.0:1788940468.105088:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944756096 00000100:00100000:2.0:1788940468.105091:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc44fb7e going to sleep for 11 seconds 00000100:00100000:3.0:1788940468.105136:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940468.105143:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c01dddcf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:6536:x1875839944756096:12345-0@lo:104: 00010000:00010000:3.0:1788940468.105155:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcce7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940468.105199:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940468.105203:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c01dddcf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:6536:x1875839944756096:12345-0@lo:104: Request processed in 62us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940468.105210:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940468.105233:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a05d2a7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875839944756096:0@lo:104: 00010000:00010000:2.0:1788940468.105251:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e3f8043a/0x9c34acc08badcd18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940468.105738:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940468.105743:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcce7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940468.105748:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000024df3b2 already unused, calling callback (000000009553f981) 10000000:00010000:0.0:1788940468.105751:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcce7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940468.105756:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcce7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940468.105761:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcce7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940468.105776:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788940468.105807:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcce0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcce7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940468.105812:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940468.105828:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcce0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcce7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940468.105834:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcce0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcce7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940468.105850:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940468.105852:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940468.105853:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940468.105954:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbd97f86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944756224:0@lo:103: 00000100:00100000:3.0:1788940468.105987:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940468.106024:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd5e36d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:6497:1875839944755968:0@lo:253: 00000100:00100000:2.0:1788940468.106036:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944756224 10000000:01000000:1.0:1788940468.106037:0:6497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000100:00100000:2.0:1788940468.106042:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944756224 00000020:01000004:1.0:1788940468.106043:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788940468.106047:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788940468.106049:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940468.106051:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940468.106052:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940468.106053:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940468.106055:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788940468.106056:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788940468.106057:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788940468.106058:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788940468.106060:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940468.106062:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1788940468.106069:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005ca49046/0x9c34acc08badcce7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcce0 expref: 12 pid: 6515 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:1.0:1788940468.106072:0:6497:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788940468.106102:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940468.106117:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002f4b666 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:3646:x1875839944756224:12345-0@lo:103: 00010000:00010000:2.0:1788940468.106128:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940468.106132:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005ca49046/0x9c34acc08badcce7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcce0 expref: 12 pid: 6515 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940468.106143:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005ca49046/0x9c34acc08badcce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badcce0 expref: 12 pid: 6515 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940468.106154:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005ca49046/0x9c34acc08badcce7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badcce0 expref: 12 pid: 6515 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940468.106166:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e3f8043a/0x9c34acc08badcd18 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940468.106173:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3f8043a/0x9c34acc08badcd18 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788940468.106186:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002134513s 00010000:00010000:2.0:1788940468.106190:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e3f8043a/0x9c34acc08badcd18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940468.106196:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e3f8043a/0x9c34acc08badcd18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940468.106202:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e3f8043a/0x9c34acc08badcd18 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940468.106207:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e3f8043a/0x9c34acc08badcd18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940468.106212:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e3f8043a already unused, calling callback (000000007b9d4142) 00010000:00010000:2.0:1788940468.106221:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e3f8043a/0x9c34acc08badcd18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940468.106228:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e3f8043a/0x9c34acc08badcd18 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940468.106595:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e3f8043a/0x9c34acc08badcd18 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940468.106604:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e3f8043a/0x9c34acc08badcd18 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940468.106693:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e3f8043a/0x9c34acc08badcd18 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940468.106802:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e3f8043a/0x9c34acc08badcd18 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940468.106816:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940468.106910:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002f4b666 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+11:3646:x1875839944756224:12345-0@lo:103: Request processed in 794us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940468.106923:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940468.106939:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbd97f86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944756224:0@lo:103: 00080000:10000000:0.0:1788940468.114126:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1788940468.114528:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788940468.117238:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1788940468.117657:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788940468.118148:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1788940468.118457:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788940468.119612:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1788940468.119816:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788940468.120024:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1788940468.120196:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788940468.120906:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1788940468.121121:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1788940468.124497:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788940468.139006:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788940468.139521:0:6553:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788940468.141222:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788940468.141369:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788940468.141842:0:6497:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788940468.141849:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788940468.141958:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940468.142946:0:6497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:1.0:1788940468.144726:0:6552:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788940468.144732:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:2.0:1788940468.151889:0:6553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940468.156646:0:6497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:00080000:2.0:1788940468.158086:0:6553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788940468.158160:0:6553:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788940468.158166:0:6553:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788940468.166945:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788940468.167607:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788940468.170015:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1788940468.190924:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788940468.191118:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788940468.191324:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788940468.191641:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788940468.191887:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788940468.192019:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788940468.192230:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788940468.196475:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788940468.196675:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788940468.196860:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788940468.196991:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788940468.197107:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788940468.197229:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788940468.197537:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788940468.197724:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788940468.197817:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788940468.198072:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788940468.198217:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788940468.198399:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788940468.198522:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788940468.198669:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788940468.198848:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788940468.198968:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788940468.199098:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788940468.199224:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788940468.199478:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788940468.199650:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788940468.199854:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788940468.199987:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788940468.200155:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788940468.200363:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788940468.200474:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788940468.200755:0:6497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788940468.204379:0:6497:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788940468.204414:0:6497:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9d58417eb988 00100000:10000000:2.0:1788940468.204422:0:6497:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788940468.204751:0:6497:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788940468.204767:0:6497:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788940468.204782:0:6497:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788940468.204798:0:6497:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788940468.205633:0:6497:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788940468.205791:0:6497:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788940468.478373:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940469.536553:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940470.556804:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940471.580108:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940472.605617:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788940473.502671:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788940473.502682:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788940473.502684:0:8:0:(import.c:65:import_set_state_nolock()) 00000000d7184638 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788940473.502696:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d7184638 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1788940473.502717:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cf6d7c0b x1875839944756480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940473.502749:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf6d7c0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875839944756480:0@lo:38: 00000100:00100000:0.0:1788940473.502813:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940473.505394:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944756480 00000100:00100000:2.0:1788940473.505408:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944756480 00000100:00100000:2.0:1788940473.505455:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940473.505464:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a643f51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875839944756480:12345-0@lo:38: 00010000:00080000:2.0:1788940473.505491:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:2.0:1788940473.505540:0:6522:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9c34acc08badcd1f 00000004:00100000:2.0:1788940473.505585:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788940473.505708:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000f089de3b : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940473.505779:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a643f51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875839944756480:12345-0@lo:38: Request processed in 315us (2966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940473.505786:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940473.505881:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036e95bc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944756352:0@lo:400: 00000100:00100000:2.0:1788940473.505915:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940473.505944:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944756352 00000100:00100000:2.0:1788940473.505947:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944756352 00000100:00100000:2.0:1788940473.505972:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788940473.505977:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093c29813 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+11:3647:x1875839944756352:12345-0@lo:400: 00000100:00100000:2.0:1788940473.506022:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093c29813 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+11:3647:x1875839944756352:12345-0@lo:400: Request processed in 45us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940473.506029:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788940473.506063:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036e95bc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944756352:0@lo:400: 00010000:00080000:0.0:1788940473.506312:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cf6d7c0b x1875839944756480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788940473.506327:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788940473.506334:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788940473.506338:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788940473.506341:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000d7184638 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788940473.506345:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf6d7c0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875839944756480:0@lo:38: 00010000:00010000:3.0:1788940473.627575:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788940474.524769:0:6798:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788940474.654451:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788940475.038174:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788940475.038182:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d004f4a000 from 3 10000000:01000000:2.0:1788940475.038188:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788940475.038247:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 0000000061758466/0x9c34acc08badcd26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940475.038346:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 0000000061758466/0x9c34acc08badcd26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940475.038368:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 0000000061758466/0x9c34acc08badcd26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940475.038409:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a05d2a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944756608:0@lo:101: 00000100:00100000:2.0:1788940475.038478:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940475.039398:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca0820be going to sleep for 11 seconds 00000100:00100000:3.0:1788940475.039473:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944756608 00000100:00100000:3.0:1788940475.039482:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944756608 00000100:00100000:3.0:1788940475.040074:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788940475.040086:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000374cef2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+11:6517:x1875839944756608:12345-0@lo:101: 00010000:00010000:3.0:1788940475.040104:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940475.040124:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a8be9634/0x9c34acc08badcd2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcd26 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940475.040154:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a8be9634/0x9c34acc08badcd2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcd26 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940475.040166:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a8be9634/0x9c34acc08badcd2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcd26 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940475.040175:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a8be9634, rc 0) 00000100:00100000:3.0:1788940475.040251:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000374cef2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:6517:x1875839944756608:12345-0@lo:101: Request processed in 167us (1773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940475.040428:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a05d2a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944756608:0@lo:101: 00010000:00010000:1.0:1788940475.040445:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 0000000061758466/0x9c34acc08badcd26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcd2d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940475.040455:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 0000000061758466/0x9c34acc08badcd26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcd2d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940475.040539:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd5e36d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944756736:0@lo:256: 00000100:00100000:1.0:1788940475.040590:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940475.040615:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fcad6c18 going to sleep for 11 seconds 00000100:00100000:1.0:1788940475.040628:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944756736 00000100:00100000:1.0:1788940475.040633:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944756736 00000100:00100000:1.0:1788940475.040659:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788940475.040665:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018a7260c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+13:6517:x1875839944756736:12345-0@lo:256: 20000000:01000000:1.0:1788940475.040677:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788940475.040691:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788940475.040695:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788940475.040761:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018a7260c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+13:6517:x1875839944756736:12345-0@lo:256: Request processed in 96us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940475.040768:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788940475.040802:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd5e36d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944756736:0@lo:256: 10000000:01000000:1.0:1788940475.040839:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788940475.040844:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 0000000061758466/0x9c34acc08badcd26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcd2d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940475.040851:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 0000000061758466/0x9c34acc08badcd26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcd2d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940475.041427:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1788940475.676623:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788940475.802165:0:6850:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788940475.802447:0:6850:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788940476.700402:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940477.724282:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940478.629128:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a52f424 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944756864:0@lo:400: 00000100:00100000:2.0:1788940478.629221:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940478.629311:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a55394a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944756992:0@lo:400: 00000100:00100000:2.0:1788940478.629355:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940478.629401:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944756864 00000100:00100000:2.0:1788940478.629410:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944756864 00000100:00100000:1.0:1788940478.639616:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944756992 00000100:00100000:1.0:1788940478.639634:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944756992 00000100:00100000:1.0:1788940478.639701:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940478.639712:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c56cc853 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944756992:12345-0@lo:400: 00000100:00100000:1.0:1788940478.639840:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c56cc853 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944756992:12345-0@lo:400: Request processed in 130us (10484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940478.639855:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788940478.640242:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a55394a4 x1875839944756992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940478.640277:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a55394a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944756992:0@lo:400: 00000100:00100000:0.0:1788940478.645454:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788940478.645478:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000872f6bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:3648:x1875839944756864:12345-0@lo:400: 00000100:00100000:0.0:1788940478.645583:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000872f6bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:3648:x1875839944756864:12345-0@lo:400: Request processed in 116us (16363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940478.645592:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788940478.645722:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a52f424 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944756864:0@lo:400: 00010000:00010000:1.0:1788940478.755690:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788940478.882671:0:6952:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788940478.883491:0:6952:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788940479.774238:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940480.796814:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940481.819814:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940482.845284:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940483.748438:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940483.748461:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd5e36d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944757120:0@lo:400: 00000100:00100000:1.0:1788940483.748543:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940483.748682:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940483.748692:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001410649c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944757248:0@lo:400: 00000100:00100000:3.0:1788940483.748740:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940483.748784:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944757120 00000100:00100000:3.0:1788940483.748791:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944757120 00000100:00100000:3.0:1788940483.748845:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940483.748853:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aca43cac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:3645:x1875839944757120:12345-0@lo:400: 00000100:00100000:3.0:1788940483.748907:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aca43cac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:3645:x1875839944757120:12345-0@lo:400: Request processed in 56us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940483.748914:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940483.748958:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd5e36d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944757120:0@lo:400: 00000100:00100000:1.0:1788940483.750628:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944757248 00000100:00100000:1.0:1788940483.750640:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944757248 00000100:00100000:1.0:1788940483.750684:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940483.750692:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049d58d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944757248:12345-0@lo:400: 00000100:00100000:1.0:1788940483.750763:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049d58d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944757248:12345-0@lo:400: Request processed in 72us (2024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940483.750771:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788940483.752060:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001410649c x1875839944757248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940483.752077:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001410649c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944757248:0@lo:400: 00010000:00010000:0.0:1788940483.868293:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940484.894714:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940485.916875:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940486.946682:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940487.966361:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940488.859543:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7589361 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944757376:0@lo:400: 00000100:00100000:3.0:1788940488.859621:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940488.859800:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036022e82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944757504:0@lo:400: 00000100:00100000:0.0:1788940488.859847:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940488.859957:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944757376 00000100:00100000:2.0:1788940488.859966:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944757376 00000100:00100000:2.0:1788940488.860014:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940488.860022:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048448d1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:3648:x1875839944757376:12345-0@lo:400: 00000100:00100000:2.0:1788940488.860077:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048448d1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:3648:x1875839944757376:12345-0@lo:400: Request processed in 56us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940488.860085:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940488.860152:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7589361 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944757376:0@lo:400: 00000100:00100000:3.0:1788940488.860432:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944757504 00000100:00100000:3.0:1788940488.860438:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944757504 00000100:00100000:3.0:1788940488.860490:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940488.860497:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf6d7c0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944757504:12345-0@lo:400: 00000100:00100000:3.0:1788940488.864502:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf6d7c0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944757504:12345-0@lo:400: Request processed in 3998us (4646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940488.864533:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788940488.864923:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000036022e82 x1875839944757504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940488.865005:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036022e82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944757504:0@lo:400: 00010000:00010000:1.0:1788940489.001802:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940490.011351:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788940490.655709:0:7450:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788940490.655714:0:7450:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788940490.655715:0:7450:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788940490.658784:0:7450:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000006759060 00000020:01000004:3.0:1788940490.658882:0:7450:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1788940490.658896:0:7450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788940490.658912:0:7450:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000e96905cb) 00000020:00000080:3.0:1788940490.658929:0:7450:0:(obd_config.c:786:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788940490.701698:0:7450:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1788940490.701784:0:7450:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1788940490.718872:0:7450:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788940490.719132:0:7450:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788940490.719147:0:7450:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788940490.719162:0:7450:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9c34acc08badcd3b 00000020:01000004:2.0:1788940490.719169:0:7450:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788940490.719196:0:7450:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788940490.719199:0:7450:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788940490.719204:0:7450:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788940490.719232:0:7450:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788940490.719236:0:7450:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788940490.733183:0:7450:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788940490.733229:0:7450:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.125@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1788940490.733234:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788940490.733236:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788940490.733237:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940490.733239:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940490.733240:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940490.733241:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940490.733243:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940490.733244:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940490.733246:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940490.733247:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940490.733249:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940490.733253:0:7450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1788940490.733445:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940490.733447:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788940490.733448:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940490.733449:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940490.733450:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940490.733451:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940490.733452:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940490.733453:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940490.733454:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940490.733455:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940490.733456:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940490.733481:0:7450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788940490.733498:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a46dd31a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944757632:0@lo:253: 00000100:00100000:2.0:1788940490.733570:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940490.733721:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d38d2095 going to sleep for 11 seconds 00000100:00100000:3.0:1788940490.733763:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944757632 00000100:00100000:3.0:1788940490.733771:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944757632 00000100:00100000:3.0:1788940490.733851:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788940490.733860:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098f17d02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:7450:x1875839944757632:12345-0@lo:253: 20000000:01000000:3.0:1788940490.733891:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788940490.733895:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1788940490.733900:0:6515:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1788940490.733903:0:6515:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1788940490.733938:0:6515:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1788940490.734130:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940490.734291:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788940490.734307:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788940490.734324:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788940490.734338:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788940490.734353:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788940490.734409:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1788940490.734417:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1788940490.734429:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1788940490.734433:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1788940490.734443:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1788940490.734447:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1788940490.734460:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788940490.734486:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788940490.734592:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1788940490.734601:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:3.0:1788940490.734614:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1788940490.734620:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788940490.734704:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1788940490.734714:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:3.0:1788940490.734730:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1788940490.734736:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788940490.734748:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788940490.734762:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788940490.734772:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788940490.734851:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1788940490.734860:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1788940490.734873:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788940490.734889:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788940490.734905:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1788940490.734910:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1788940490.734922:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788940490.734941:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788940490.734946:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1788940490.734966:0:6515:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788940490.734972:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1788940490.735437:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788940490.735624:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788940490.735707:0:6515:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.125@tcp for mdt 20000000:01000000:3.0:1788940490.735709:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:3.0:1788940490.735725:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788940490.735731:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788940490.735743:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788940490.735747:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:3.0:1788940490.735774:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788940490.735782:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1788940490.735795:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1788940490.735809:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1788940490.735850:0:6515:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1788940490.735859:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1788940490.736241:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1788940490.736595:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788940490.736611:0:6515:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.125@tcp for mdt 20000000:01000000:3.0:1788940490.736613:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:3.0:1788940490.736628:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788940490.736698:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788940490.736717:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788940490.736723:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:3.0:1788940490.736736:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788940490.736743:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1788940490.736755:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788940490.736772:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1788940490.736792:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788940490.736795:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788940490.736798:0:6515:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788940490.736839:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788940490.736841:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788940490.737116:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788940490.737134:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788940490.737147:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788940490.737384:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1788940490.737405:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1788940490.737420:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1788940490.737428:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788940490.737429:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788940490.737797:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788940490.737816:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788940490.737829:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1788940490.737968:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788940490.737985:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788940490.737998:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1788940490.738008:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788940490.738015:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788940490.738349:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788940490.738366:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788940490.738379:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788940490.738518:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788940490.738535:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788940490.738555:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788940490.738566:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788940490.738569:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788940490.738573:0:6515:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788940490.738579:0:6515:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788940490.738915:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1788940490.739004:0:6515:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788940490.744961:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788940490.744997:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcd42 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.745014:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000010be789b/0x9c34acc08badcc77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcc70 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.745021:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcc8c expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.745027:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b6d46e38/0x9c34acc08badcd03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badccfc expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.745033:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcd42 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.745084:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b6d46e38/0x9c34acc08badcd03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badccfc expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.745101:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b6d46e38/0x9c34acc08badcd03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badccfc expref: 12 pid: 6513 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940490.745137:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dba4c323 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1875839944757760:0@lo:104: 00000100:00100000:3.0:1788940490.745203:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940490.745287:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badcc8c expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.745293:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badcc8c expref: 12 pid: 6515 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940490.745299:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063a3e2ec pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1875839944757888:0@lo:104: 00000100:00100000:3.0:1788940490.745315:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940490.745337:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944757760 00000100:00100000:3.0:1788940490.745343:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944757760 00000100:00100000:3.0:1788940490.745377:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944757888 00000100:00100000:3.0:1788940490.745380:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944757888 00000100:00100000:3.0:1788940490.745393:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940490.745400:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c11a8dd8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:6515:x1875839944757760:12345-0@lo:104: 00010000:00010000:3.0:1788940490.745412:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badccfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcd03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.745447:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940490.745450:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c11a8dd8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:6515:x1875839944757760:12345-0@lo:104: Request processed in 52us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940490.745455:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940490.745466:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940490.745470:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072b025ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:6515:x1875839944757888:12345-0@lo:104: 00010000:00010000:3.0:1788940490.745474:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badcc8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcc93 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.745503:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788940490.745505:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072b025ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:6515:x1875839944757888:12345-0@lo:104: Request processed in 36us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940490.745509:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788940490.745520:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940490.745524:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badccfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcd03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.745529:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006c81f3d6 already unused, calling callback (000000009553f981) 10000000:00010000:3.0:1788940490.745531:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badccfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcd03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.745535:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badccfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcd03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940490.745539:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badccfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcd03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940490.745542:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940490.745561:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badccfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcd03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.745565:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940490.745577:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badccfc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcd03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.745581:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badccfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcd03 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.745597:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940490.745599:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badcc8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcc93 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.745602:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c38d8ba8 already unused, calling callback (000000009553f981) 10000000:00010000:3.0:1788940490.745603:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badcc8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcc93 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.745606:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badcc8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcc93 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940490.745609:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badcc8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcc93 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940490.745614:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940490.745623:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badcc8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcc93 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.745894:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788940490.745931:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9482c4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944758144:0@lo:103: 00000100:00100000:2.0:1788940490.745959:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940490.746004:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badcc8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcc93 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.746011:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badcc8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcc93 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.746020:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940490.746022:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940490.746023:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940490.746028:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940490.746048:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000026181832 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944758016:0@lo:103: 00000100:00100000:3.0:1788940490.746088:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940490.746120:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944758144 00000100:00100000:3.0:1788940490.746124:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944758144 00010000:00010000:3.0:1788940490.746140:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc93 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcc8c expref: 13 pid: 6515 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940490.746157:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944758016 00000100:00100000:3.0:1788940490.746159:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944758016 00010000:00010000:3.0:1788940490.746165:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b6d46e38/0x9c34acc08badcd03 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badccfc expref: 14 pid: 6513 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940490.746175:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940490.746181:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f68f045f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:3647:x1875839944758144:12345-0@lo:103: 00010000:00010000:3.0:1788940490.746203:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940490.746208:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc93 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcc8c expref: 14 pid: 6515 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.746215:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc93 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badcc8c expref: 14 pid: 6515 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.746229:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940490.746460:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f68f045f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:3647:x1875839944758144:12345-0@lo:103: Request processed in 279us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940490.746467:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940490.746480:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940490.746485:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8edac48 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+13:3646:x1875839944758016:12345-0@lo:103: 00010000:00010000:3.0:1788940490.746492:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940490.746495:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b6d46e38/0x9c34acc08badcd03 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badccfc expref: 13 pid: 6513 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.746507:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b6d46e38/0x9c34acc08badcd03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badccfc expref: 13 pid: 6513 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.746516:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940490.746576:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8edac48 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+13:3646:x1875839944758016:12345-0@lo:103: Request processed in 92us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940490.746583:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788940490.746622:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000010be789b/0x9c34acc08badcc77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badcc70 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.746643:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000010be789b/0x9c34acc08badcc77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badcc70 expref: 12 pid: 6512 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940490.746652:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000011dd820 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1875839944758272:0@lo:104: 00000100:00100000:3.0:1788940490.746674:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940490.746773:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 000000008f06f035 going to sleep for 11 seconds 00010000:00010000:3.0:1788940490.746790:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b6d46e38/0x9c34acc08badcd03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badccfc expref: 12 pid: 6513 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940490.746799:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dba4c323 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1875839944757760:0@lo:104: 00010000:00010000:3.0:1788940490.746808:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a0c5de69/0x9c34acc08badcc93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badcc8c expref: 11 pid: 6515 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940490.746816:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063a3e2ec pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1875839944757888:0@lo:104: 00000100:00100000:0.0:1788940490.746856:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000026181832 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944758016:0@lo:103: 00000100:00100000:1.0:1788940490.746892:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944758272 00000100:00100000:1.0:1788940490.746897:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944758272 00000100:00100000:1.0:1788940490.746955:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788940490.746960:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb221da3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:6515:x1875839944758272:12345-0@lo:104: 00010000:00010000:1.0:1788940490.746966:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badcc70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcc77 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.747007:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788940490.747012:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb221da3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:6515:x1875839944758272:12345-0@lo:104: Request processed in 53us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940490.747018:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940490.747053:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9482c4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944758144:0@lo:103: 00010000:00010000:3.0:1788940490.747104:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940490.747108:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badcc70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcc77 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747124:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b681abb9 already unused, calling callback (000000009553f981) 10000000:00010000:3.0:1788940490.747127:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badcc70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcc77 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747132:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badcc70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcc77 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940490.747136:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badcc70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcc77 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940490.747139:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940490.747160:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badcc70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcc77 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747163:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940490.747173:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badcc70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcc77 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747178:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badcc70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcc77 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747191:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940490.747192:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940490.747194:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940490.747202:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ad8ccee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944758400:0@lo:103: 00000100:00100000:3.0:1788940490.747226:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940490.747246:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944758400 00000100:00100000:3.0:1788940490.747249:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944758400 00010000:00010000:3.0:1788940490.747278:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000010be789b/0x9c34acc08badcc77 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcc70 expref: 11 pid: 6512 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940490.747296:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940490.747300:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088d5b5e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+11:3648:x1875839944758400:12345-0@lo:103: 00010000:00010000:3.0:1788940490.747306:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940490.747308:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000010be789b/0x9c34acc08badcc77 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcc70 expref: 11 pid: 6512 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747313:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000010be789b/0x9c34acc08badcc77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badcc70 expref: 11 pid: 6512 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747321:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcd42 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747326:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcd42 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747335:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcd42 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747339:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcd42 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747343:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcd42 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747346:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcd42 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747349:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008a05d1f7 already unused, calling callback (000000007b9d4142) 00010000:00010000:3.0:1788940490.747351:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcd42 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747362:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcd42 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747369:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcd42 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747378:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940490.747402:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088d5b5e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+11:3648:x1875839944758400:12345-0@lo:103: Request processed in 101us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940490.747408:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940490.747428:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ad8ccee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944758400:0@lo:103: 00010000:00010000:3.0:1788940490.747439:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000010be789b/0x9c34acc08badcc77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badcc70 expref: 10 pid: 6512 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940490.747446:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000011dd820 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1875839944758272:0@lo:104: 00010000:00010000:3.0:1788940490.747455:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcd42 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747460:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcd42 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747464:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcd42 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.747467:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcd42 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788940490.747476:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788940490.749486:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098f17d02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+9:7450:x1875839944757632:12345-0@lo:253: Request processed in 15621us (15910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940490.749504:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788940490.749658:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a46dd31a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944757632:0@lo:253: 10000000:01000000:2.0:1788940490.749671:0:7450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788940490.749674:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788940490.749675:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788940490.749676:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940490.749677:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1788940490.749678:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940490.749679:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940490.749680:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940490.749681:0:7450:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788940490.749682:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940490.749683:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788940490.749699:0:7450:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000006759060 from lustre-MDT0001 10000000:01000000:2.0:1788940490.749736:0:7450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788940490.749739:0:7450:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788940490.749744:0:7450:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91d00509b3b0 local copy 10000000:01000000:2.0:1788940490.749748:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788940490.749777:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000aa93aac0/0x9c34acc08badcd49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.749783:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.125@tcp lock: 00000000aa93aac0/0x9c34acc08badcd49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.749790:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000aa93aac0/0x9c34acc08badcd49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940490.749806:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a46dd31a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944758528:0@lo:101: 00000100:00100000:2.0:1788940490.749841:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940490.749898:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b652cb9d going to sleep for 11 seconds 00000100:00100000:3.0:1788940490.750001:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944758528 00000100:00100000:3.0:1788940490.750006:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944758528 00000100:00100000:3.0:1788940490.750079:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788940490.750088:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb5507dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+9:7450:x1875839944758528:12345-0@lo:101: 00010000:00010000:3.0:1788940490.750100:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940490.750113:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000237a012b/0x9c34acc08badcd50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcd49 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.750135:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000237a012b/0x9c34acc08badcd50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcd49 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.750142:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000237a012b/0x9c34acc08badcd50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcd49 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.750148:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000237a012b, rc 0) 00000100:00100000:3.0:1788940490.750224:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb5507dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+10:7450:x1875839944758528:12345-0@lo:101: Request processed in 138us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940490.750230:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788940490.750287:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a46dd31a pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944758528:0@lo:101: 00010000:00010000:1.0:1788940490.750296:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000aa93aac0/0x9c34acc08badcd49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9c34acc08badcd50 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.750302:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000aa93aac0/0x9c34acc08badcd49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9c34acc08badcd50 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.750389:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944758656:0@lo:501: 00000100:00100000:1.0:1788940490.750414:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.750598:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000033ae13d3 going to sleep for 11 seconds 00000100:00100000:2.0:1788940490.750649:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944758656 00000100:00100000:2.0:1788940490.750653:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944758656 00000100:00100000:2.0:1788940490.750678:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788940490.750681:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be9303b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+10:7450:x1875839944758656:12345-0@lo:501: 00000100:00100000:2.0:1788940490.750731:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be9303b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+10:7450:x1875839944758656:12345-0@lo:501: Request processed in 50us (318us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788940490.750735:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788940490.750830:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944758656:0@lo:501: 10000000:01000000:1.0:1788940490.750842:0:7450:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788940490.750857:0:7450:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788940490.750861:0:7450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000aa93aac0/0x9c34acc08badcd49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9c34acc08badcd50 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.750866:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000aa93aac0/0x9c34acc08badcd49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9c34acc08badcd50 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.750870:0:7450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: 00000000aa93aac0/0x9c34acc08badcd49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9c34acc08badcd50 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.750894:0:7450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788940490.750914:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91d034739000 10000000:01000000:1.0:1788940490.750919:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788940490.750923:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91d00509b3b0 10000000:01000000:1.0:1788940490.750925:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788940490.750928:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff91d00509b3b0 from 1 10000000:01000000:1.0:1788940490.750930:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788940490.750945:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000173348c3/0x9c34acc08badcd57 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.750949:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000173348c3/0x9c34acc08badcd57 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.750954:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000173348c3/0x9c34acc08badcd57 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.750962:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944758784:0@lo:101: 00000100:00100000:1.0:1788940490.750978:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.750986:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c177109 going to sleep for 11 seconds 00010000:00010000:2.0:1788940490.751028:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940490.751034:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: 00000000aa93aac0/0x9c34acc08badcd49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9c34acc08badcd50 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.751040:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aa93aac0 already unused, calling callback (000000009553f981) 10000000:00010000:2.0:1788940490.751042:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: 00000000aa93aac0/0x9c34acc08badcd49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9c34acc08badcd50 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.751050:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: 00000000aa93aac0/0x9c34acc08badcd49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x9c34acc08badcd50 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940490.751056:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: 00000000aa93aac0/0x9c34acc08badcd49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x9c34acc08badcd50 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940490.751062:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940490.751105:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: 00000000aa93aac0/0x9c34acc08badcd49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c34acc08badcd50 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.751112:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940490.751140:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: 00000000aa93aac0/0x9c34acc08badcd49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c34acc08badcd50 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.751147:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: 00000000aa93aac0/0x9c34acc08badcd49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c34acc08badcd50 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.751166:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940490.751167:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940490.751168:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940490.751175:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944758784 00000100:00100000:2.0:1788940490.751179:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944758784 00000100:00100000:2.0:1788940490.751196:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788940490.751200:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae8b2594 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+10:7450:x1875839944758784:12345-0@lo:101: 00010000:00010000:2.0:1788940490.751207:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940490.751216:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fe5b8bc8/0x9c34acc08badcd5e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcd57 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.751230:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fe5b8bc8/0x9c34acc08badcd5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcd57 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.751238:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fe5b8bc8/0x9c34acc08badcd5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcd57 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.751243:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fe5b8bc8, rc 0) 00000100:00100000:2.0:1788940490.751292:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae8b2594 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+11:7450:x1875839944758784:12345-0@lo:101: Request processed in 92us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.751297:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788940490.751361:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000785f2d3f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944758912:0@lo:103: 00000100:00100000:1.0:1788940490.751389:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.751439:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944758784:0@lo:101: 00010000:00010000:1.0:1788940490.751446:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000173348c3/0x9c34acc08badcd57 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcd5e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.751450:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000173348c3/0x9c34acc08badcd57 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcd5e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940490.751468:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788940490.751473:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000173348c3/0x9c34acc08badcd57 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcd5e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.751477:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 00000000173348c3/0x9c34acc08badcd57 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcd5e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940490.751482:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91d034739000 10000000:01000000:1.0:1788940490.751483:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788940490.751485:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91d034739000 from 1 10000000:01000000:1.0:1788940490.751486:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788940490.751496:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 0000000064f8e8ad/0x9c34acc08badcd65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.751500:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 0000000064f8e8ad/0x9c34acc08badcd65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.751504:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 0000000064f8e8ad/0x9c34acc08badcd65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.751511:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944759040:0@lo:101: 00000100:00100000:1.0:1788940490.751526:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.751532:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c177109 going to sleep for 11 seconds 00000100:00100000:2.0:1788940490.751577:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944758912 00000100:00100000:2.0:1788940490.751581:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944758912 00000100:00100000:2.0:1788940490.751616:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940490.751622:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7832e28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+11:3645:x1875839944758912:12345-0@lo:103: 00010000:00010000:2.0:1788940490.751738:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940490.751748:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000237a012b/0x9c34acc08badcd50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badcd49 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.751764:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940490.751800:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7832e28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+10:3645:x1875839944758912:12345-0@lo:103: Request processed in 179us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.751807:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940490.751823:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944759040 00000100:00100000:2.0:1788940490.751827:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944759040 00000100:00100000:2.0:1788940490.751840:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788940490.751844:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000266a223f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+10:7450:x1875839944759040:12345-0@lo:101: 00010000:00010000:2.0:1788940490.751851:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940490.751858:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d9dae9a4/0x9c34acc08badcd6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcd65 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.751870:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d9dae9a4/0x9c34acc08badcd6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcd65 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.751877:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d9dae9a4/0x9c34acc08badcd6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcd65 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.751882:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d9dae9a4, rc 0) 00000100:00100000:2.0:1788940490.751905:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000266a223f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+11:7450:x1875839944759040:12345-0@lo:101: Request processed in 61us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.751911:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788940490.751971:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000785f2d3f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944758912:0@lo:103: 00000100:00100000:1.0:1788940490.751993:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944759040:0@lo:101: 00010000:00010000:1.0:1788940490.751999:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 0000000064f8e8ad/0x9c34acc08badcd65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcd6c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.752014:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 0000000064f8e8ad/0x9c34acc08badcd65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcd6c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940490.752024:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788940490.752035:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 0000000064f8e8ad/0x9c34acc08badcd65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcd6c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.752041:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 0000000064f8e8ad/0x9c34acc08badcd65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcd6c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940490.752047:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788940490.752050:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788940490.752054:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91d034739000 10000000:01000000:1.0:1788940490.752056:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788940490.752059:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788940490.752061:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788940490.752083:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000594c2e96/0x9c34acc08badcd73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.752089:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000594c2e96/0x9c34acc08badcd73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.752096:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000594c2e96/0x9c34acc08badcd73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.752107:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944759168:0@lo:101: 00000100:00100000:1.0:1788940490.752129:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.752137:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c177109 going to sleep for 11 seconds 00000100:00100000:2.0:1788940490.752186:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944759168 00000100:00100000:2.0:1788940490.752190:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944759168 00000100:00100000:2.0:1788940490.752206:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788940490.752210:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000554f384 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+11:7450:x1875839944759168:12345-0@lo:101: 00010000:00010000:2.0:1788940490.752216:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940490.752228:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dcffc6fb/0x9c34acc08badcd7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcd73 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.752239:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dcffc6fb/0x9c34acc08badcd7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcd73 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.752244:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dcffc6fb/0x9c34acc08badcd7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcd73 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.752248:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dcffc6fb, rc 0) 00000100:00100000:2.0:1788940490.752347:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000554f384 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:7450:x1875839944759168:12345-0@lo:101: Request processed in 137us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.752351:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788940490.752582:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944759168:0@lo:101: 00010000:00010000:1.0:1788940490.752589:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000594c2e96/0x9c34acc08badcd73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcd7a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.752594:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000594c2e96/0x9c34acc08badcd73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcd7a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.752669:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944759296:0@lo:501: 00000100:00100000:1.0:1788940490.752686:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.752706:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c177109 going to sleep for 11 seconds 00000100:00100000:2.0:1788940490.752780:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944759296 00000100:00100000:2.0:1788940490.752784:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944759296 00000100:00100000:2.0:1788940490.752807:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788940490.752813:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000000481ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:7450:x1875839944759296:12345-0@lo:501: 00000100:00100000:2.0:1788940490.752902:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000000481ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:7450:x1875839944759296:12345-0@lo:501: Request processed in 89us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.752908:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788940490.752981:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944759296:0@lo:501: 00000100:00100000:1.0:1788940490.752999:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944759424:0@lo:503: 00000100:00100000:1.0:1788940490.753033:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.753053:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c177109 going to sleep for 11 seconds 00000100:00100000:2.0:1788940490.753104:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944759424 00000100:00100000:2.0:1788940490.753109:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944759424 00000100:00100000:2.0:1788940490.753135:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788940490.753141:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9cd8d60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:7450:x1875839944759424:12345-0@lo:503: 00000100:00100000:2.0:1788940490.753215:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9cd8d60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:7450:x1875839944759424:12345-0@lo:503: Request processed in 73us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.753222:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788940490.753365:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944759424:0@lo:503: 00000040:00080000:1.0:1788940490.753622:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788940490.753709:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944759552:0@lo:502: 00000100:00100000:1.0:1788940490.753742:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.753770:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c177109 going to sleep for 11 seconds 00000100:00100000:2.0:1788940490.753872:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944759552 00000100:00100000:2.0:1788940490.753877:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944759552 00000100:00100000:2.0:1788940490.753916:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788940490.753921:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094f14992 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:7450:x1875839944759552:12345-0@lo:502: 00000100:00100000:2.0:1788940490.753994:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094f14992 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:7450:x1875839944759552:12345-0@lo:502: Request processed in 73us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.754001:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788940490.754104:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944759552:0@lo:502: 00000040:00080000:1.0:1788940490.754305:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788940490.754322:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788940490.754330:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788940490.754336:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788940490.754342:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788940490.754349:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788940490.754359:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788940490.754380:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788940490.754393:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788940490.754405:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788940490.754416:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788940490.754422:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788940490.754429:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788940490.754435:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788940490.754441:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788940490.754459:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788940490.754466:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788940490.754473:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788940490.754479:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788940490.754485:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788940490.754491:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788940490.754498:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788940490.754504:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788940490.754517:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944759680:0@lo:502: 00000100:00100000:1.0:1788940490.754541:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.754553:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c177109 going to sleep for 11 seconds 00000100:00100000:2.0:1788940490.754686:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944759680 00000100:00100000:2.0:1788940490.754690:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944759680 00000100:00100000:2.0:1788940490.754735:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788940490.754739:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5593acc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:7450:x1875839944759680:12345-0@lo:502: 00000100:00100000:2.0:1788940490.754783:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5593acc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:7450:x1875839944759680:12345-0@lo:502: Request processed in 45us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.754788:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788940490.754848:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944759680:0@lo:502: 00000040:00080000:1.0:1788940490.754877:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1788940490.754881:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1788940490.755707:0:7462:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940490.755718:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940490.755720:0:7462:0:(obd_config.c:1662:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788940490.755724:0:7462:0:(obd_config.c:2066:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788940490.755726:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788940490.755736:0:7462:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000034a406ab) 00000020:00000080:0.0:1788940490.755750:0:7462:0:(obd_config.c:786:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1788940490.755762:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788940490.755832:0:7462:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788940490.755840:0:7462:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9c34acc08badcd88 00000020:00000080:0.0:1788940490.756040:0:7462:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788940490.756044:0:7462:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940490.756048:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940490.756049:0:7462:0:(obd_config.c:1662:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788940490.756052:0:7462:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940490.756055:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940490.756056:0:7462:0:(obd_config.c:1662:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788940490.756059:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788940490.756065:0:7462:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0001 (00000000de2c0860) 00000020:00000080:0.0:1788940490.756087:0:7462:0:(obd_config.c:786:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1788940490.756091:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788940490.756093:0:7462:0:(obd_config.c:1615:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788940490.756095:0:7462:0:(obd_config.c:1248:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788940490.756101:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788940490.756157:0:7462:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000006759060 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788940490.756170:0:7462:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDD0001 (0000000078b08fb3) 00000020:00000080:0.0:1788940490.756178:0:7462:0:(obd_config.c:786:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1788940490.756240:0:7462:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788940490.756244:0:7462:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08badcd9d 00000020:00000080:0.0:1788940490.756459:0:7462:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788940490.756468:0:7462:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788940490.756471:0:7462:0:(genops.c:1393:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x9c34acc08badcda4 00080000:01000000:0.0:1788940490.756475:0:7462:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788940490.756478:0:7462:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9c34acc08badcdab 00080000:10000000:0.0:1788940490.756906:0:7462:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1788940490.757013:0:7462:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1788940490.825180:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1788940490.825509:0:7462:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1788940490.829773:0:7462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788940490.830438:0:7462:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788940490.842095:0:7462:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788940490.842110:0:7462:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940490.842116:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940490.842118:0:7462:0:(obd_config.c:1662:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788940490.842122:0:7462:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940490.842129:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940490.842130:0:7462:0:(obd_config.c:1662:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788940490.842133:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788940490.842138:0:7462:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:00000080:2.0:1788940490.842171:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788940490.842185:0:7462:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000043b9879c) 00000020:00000080:2.0:1788940490.842207:0:7462:0:(obd_config.c:786:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788940490.842214:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788940490.842311:0:7462:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788940490.842318:0:7462:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788940490.842324:0:7462:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9c34acc08badcdb9 00010000:00080000:2.0:1788940490.842353:0:7462:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a70adb0a@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:2.0:1788940490.844116:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1788940490.850892:0:7462:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788940490.850911:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788940490.850956:0:7462:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788940490.850976:0:7462:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08badcdc0 00000100:00080000:3.0:1788940490.850987:0:7462:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788940490.850993:0:7462:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000a70adb0a using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940490.851191:0:7462:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000011dd820 x1875839944759808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940490.851251:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000011dd820 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944759808:0@lo:38: 00000100:00080000:3.0:1788940490.852147:0:7462:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788940490.852233:0:7462:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940490.852239:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940490.852241:0:7462:0:(obd_config.c:1662:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788940490.852244:0:7462:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788940490.852247:0:7462:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788940490.852249:0:7462:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788940490.852250:0:7462:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788940490.852251:0:7462:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788940490.852254:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940490.852269:0:7462:0:(obd_config.c:1662:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788940490.852273:0:7462:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940490.852278:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940490.852279:0:7462:0:(obd_config.c:1662:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788940490.852282:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788940490.852325:0:7462:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788940490.852338:0:7462:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940490.852341:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940490.852343:0:7462:0:(obd_config.c:1662:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788940490.852345:0:7462:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940490.852347:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940490.852348:0:7462:0:(obd_config.c:1662:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788940490.852351:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788940490.852352:0:7462:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788940490.852381:0:7462:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940490.852384:0:7462:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940490.852385:0:7462:0:(obd_config.c:1662:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788940490.852388:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:1.0:1788940490.852580:0:7450:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1788940490.852608:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788940490.852742:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000594c2e96/0x9c34acc08badcd73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcd7a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.852752:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 00000000594c2e96/0x9c34acc08badcd73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcd7a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940490.852758:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d034739000 from 1 10000000:01000000:1.0:1788940490.852765:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788940490.852836:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 0000000060e8b36b/0x9c34acc08badcdc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.852842:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 0000000060e8b36b/0x9c34acc08badcdc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.852850:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 0000000060e8b36b/0x9c34acc08badcdc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.852865:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944759936:0@lo:101: 00000100:00100000:1.0:1788940490.852921:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.852955:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000005980a59c going to sleep for 11 seconds 00000100:00100000:1.0:1788940490.853201:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940490.853211:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a6d91e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944760064:0@lo:400: 00000100:00100000:1.0:1788940490.853239:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940490.853340:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944759936 00000100:00100000:3.0:1788940490.853347:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944759936 00000100:00100000:3.0:1788940490.853387:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788940490.853395:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000417253fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+12:7450:x1875839944759936:12345-0@lo:101: 00010000:00010000:3.0:1788940490.853407:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940490.853419:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcdce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcdc7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.853452:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcdce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcdc7 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.853462:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcdce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcdc7 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.853470:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008a05d1f7, rc 0) 00000100:00100000:3.0:1788940490.853507:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000417253fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+13:7450:x1875839944759936:12345-0@lo:101: Request processed in 113us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940490.853513:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788940490.853637:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944759936:0@lo:101: 00010000:00010000:1.0:1788940490.853649:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 0000000060e8b36b/0x9c34acc08badcdc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcdce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.853657:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 0000000060e8b36b/0x9c34acc08badcdc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcdce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.854242:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944760192:0@lo:256: 00000100:00100000:0.0:1788940490.854388:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940490.854786:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944759808 00000100:00100000:3.0:1788940490.854801:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944759808 00000100:00100000:3.0:1788940490.854830:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940490.854834:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3bfcc67 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875839944759808:12345-0@lo:38: 00010000:00080000:3.0:1788940490.854853:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:3.0:1788940490.854885:0:6525:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08badcdd5 00000004:00100000:3.0:1788940490.854898:0:6525:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788940490.854903:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788940490.855227:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.855250:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000005980a59c going to sleep for 11 seconds 00000100:00100000:3.0:1788940490.856753:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944760192 00000100:00100000:3.0:1788940490.856764:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944760192 00000100:00100000:3.0:1788940490.856814:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788940490.856821:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a7b4ce3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+13:7450:x1875839944760192:12345-0@lo:256: 20000000:01000000:3.0:1788940490.856844:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788940490.856857:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788940490.856859:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788940490.856961:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a7b4ce3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+13:7450:x1875839944760192:12345-0@lo:256: Request processed in 142us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940490.856973:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788940490.857404:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944760192:0@lo:256: 00000100:00080000:0.0:1788940490.861129:0:6525:0:(import.c:65:import_set_state_nolock()) 0000000025b5c0dd : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940490.861227:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3bfcc67 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875839944759808:12345-0@lo:38: Request processed in 6389us (6837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940490.861243:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940490.861325:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788940490.861333:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788940490.861340:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788940490.861346:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788940490.861349:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000a70adb0a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788940490.861361:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000011dd820 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944759808:0@lo:38: 00000100:00100000:0.0:1788940490.861429:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000953f4e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944760320:0@lo:41: 00000100:00100000:0.0:1788940490.861459:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940490.861501:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944760320 00000100:00100000:0.0:1788940490.861506:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944760320 00000100:00100000:0.0:1788940490.861532:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940490.861538:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7627176 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875839944760320:12345-0@lo:41: 00000004:00000024:0.0:1788940490.861563:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788940490.861589:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7627176 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875839944760320:12345-0@lo:41: Request processed in 51us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940490.861595:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:1.0:1788940490.861770:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00100000:0.0:1788940490.861883:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000953f4e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944760320:0@lo:41: 00010000:00010000:1.0:1788940490.861922:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 0000000060e8b36b/0x9c34acc08badcdc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcdce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.861933:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 0000000060e8b36b/0x9c34acc08badcdc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcdce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940490.861942:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d034739000 from 1 10000000:01000000:1.0:1788940490.861945:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940490.861968:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcddc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.861975:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcddc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.861983:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcddc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.861996:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944760448:0@lo:101: 00000100:00100000:1.0:1788940490.862034:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.862055:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000005980a59c going to sleep for 11 seconds 00000100:00100000:2.0:1788940490.862242:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944760064 00000100:00100000:2.0:1788940490.862247:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944760064 00000100:00100000:2.0:1788940490.862290:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940490.862296:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5edab75 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944760064:12345-0@lo:400: 00000100:00100000:2.0:1788940490.862333:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5edab75 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944760064:12345-0@lo:400: Request processed in 38us (9093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.862339:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788940490.862414:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944760448 00000100:00100000:0.0:1788940490.862419:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944760448 00000100:00100000:0.0:1788940490.862441:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788940490.862446:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e89dc28f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+13:7450:x1875839944760448:12345-0@lo:101: 00010000:00010000:0.0:1788940490.862453:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940490.862462:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000085866eb3/0x9c34acc08badcde3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcddc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940490.862481:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000085866eb3/0x9c34acc08badcde3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcddc expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940490.862490:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000085866eb3/0x9c34acc08badcde3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcddc expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940490.862497:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000085866eb3, rc 0) 00000100:00100000:0.0:1788940490.862521:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e89dc28f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:7450:x1875839944760448:12345-0@lo:101: Request processed in 75us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940490.862527:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788940490.862660:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007a6d91e1 x1875839944760064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940490.862671:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a6d91e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944760064:0@lo:400: 00000100:00100000:1.0:1788940490.862712:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944760448:0@lo:101: 00010000:00010000:1.0:1788940490.862724:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcddc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcde3 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.862731:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcddc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcde3 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.862974:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944760576:0@lo:501: 00000100:00100000:1.0:1788940490.862998:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.863084:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000005980a59c going to sleep for 11 seconds 00000100:00100000:2.0:1788940490.863205:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944760576 00000100:00100000:2.0:1788940490.863211:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944760576 00000100:00100000:2.0:1788940490.863295:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788940490.863303:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c7cb89f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:7450:x1875839944760576:12345-0@lo:501: 00000100:00100000:2.0:1788940490.863393:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c7cb89f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:7450:x1875839944760576:12345-0@lo:501: Request processed in 91us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.863400:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788940490.863518:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944760576:0@lo:501: 00000100:00100000:1.0:1788940490.863542:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944760704:0@lo:503: 00000100:00100000:1.0:1788940490.863578:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.863824:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000005980a59c going to sleep for 11 seconds 00000100:00100000:0.0:1788940490.863873:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944760704 00000100:00100000:0.0:1788940490.863877:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944760704 00000100:00100000:0.0:1788940490.863899:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788940490.863905:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf5575f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:7450:x1875839944760704:12345-0@lo:503: 00000040:00080000:0.0:1788940490.863936:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788940490.863979:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf5575f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:7450:x1875839944760704:12345-0@lo:503: Request processed in 75us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940490.863985:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788940490.864158:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944760704:0@lo:503: 00000040:00080000:1.0:1788940490.864420:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940490.864468:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1788940490.864537:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940490.865359:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1788940490.865406:0:7450:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788940490.865427:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940490.865441:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcddc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcde3 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.865452:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcddc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcde3 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940490.865503:0:7450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788940490.865506:0:7450:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91d034739000 10000000:01000000:1.0:1788940490.865509:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91d034739000 10000000:01000000:1.0:1788940490.865512:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788940490.865516:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91d034739000 from 1 10000000:01000000:1.0:1788940490.865519:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788940490.865547:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 0000000013dbbeea/0x9c34acc08badcdea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.865562:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 0000000013dbbeea/0x9c34acc08badcdea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.865571:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 0000000013dbbeea/0x9c34acc08badcdea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.865589:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944760832:0@lo:101: 00000100:00100000:1.0:1788940490.865637:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.865650:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f13c9cc3 going to sleep for 11 seconds 00000100:00100000:0.0:1788940490.865934:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944760832 00000100:00100000:0.0:1788940490.865942:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944760832 00000100:00100000:0.0:1788940490.865972:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788940490.865977:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068022afb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:7450:x1875839944760832:12345-0@lo:101: 00010000:00010000:0.0:1788940490.865987:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940490.865995:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000ac0ca69/0x9c34acc08badcdf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcdea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940490.866083:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ac0ca69/0x9c34acc08badcdf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcdea expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940490.866093:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000ac0ca69/0x9c34acc08badcdf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcdea expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940490.866100:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000ac0ca69, rc 0) 00000100:00100000:0.0:1788940490.866143:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068022afb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:7450:x1875839944760832:12345-0@lo:101: Request processed in 166us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940490.866150:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788940490.866228:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944760832:0@lo:101: 00010000:00010000:1.0:1788940490.866240:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 0000000013dbbeea/0x9c34acc08badcdea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcdf1 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.866248:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 0000000013dbbeea/0x9c34acc08badcdea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcdf1 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940490.867174:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944760960:0@lo:501: 00000100:00100000:1.0:1788940490.867214:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.867246:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f13c9cc3 going to sleep for 11 seconds 00000100:00100000:1.0:1788940490.867282:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944760960 00000100:00100000:1.0:1788940490.867286:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944760960 00000100:00100000:1.0:1788940490.867311:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788940490.867317:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d355f6a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:7450:x1875839944760960:12345-0@lo:501: 00000100:00100000:1.0:1788940490.867411:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d355f6a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:7450:x1875839944760960:12345-0@lo:501: Request processed in 94us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940490.867419:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788940490.867463:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944760960:0@lo:501: 00000100:00100000:1.0:1788940490.867490:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944761088:0@lo:503: 00000100:00100000:1.0:1788940490.867525:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.867537:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f13c9cc3 going to sleep for 11 seconds 00000100:00100000:1.0:1788940490.867549:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944761088 00000100:00100000:1.0:1788940490.867552:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944761088 00000100:00100000:1.0:1788940490.867568:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788940490.867573:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d7bf53a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:7450:x1875839944761088:12345-0@lo:503: 00000100:00100000:1.0:1788940490.867916:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d7bf53a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:7450:x1875839944761088:12345-0@lo:503: Request processed in 343us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940490.867923:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788940490.868029:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083ca5d0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944761088:0@lo:503: 00000040:00080000:0.0:1788940490.868482:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788940490.868532:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000953f4e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944761216:0@lo:502: 00000100:00100000:0.0:1788940490.868562:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940490.868586:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000266293ef going to sleep for 11 seconds 00000100:00100000:1.0:1788940490.868622:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944761216 00000100:00100000:1.0:1788940490.868626:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944761216 00000100:00100000:1.0:1788940490.868653:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788940490.868657:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a40f871 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:7450:x1875839944761216:12345-0@lo:502: 00000100:00100000:1.0:1788940490.868716:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a40f871 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:7450:x1875839944761216:12345-0@lo:502: Request processed in 58us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940490.868721:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788940490.868877:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000953f4e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944761216:0@lo:502: 00000040:00080000:0.0:1788940490.869025:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788940490.869046:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788940490.869061:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788940490.869084:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788940490.869115:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788940490.869131:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788940490.869152:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788940490.869167:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788940490.869181:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788940490.869194:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788940490.869206:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788940490.869218:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788940490.869230:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788940490.869243:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788940490.869391:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788940490.869411:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788940490.869424:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788940490.869436:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788940490.869447:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788940490.869464:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788940490.869488:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788940490.869502:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788940490.869514:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788940490.869527:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788940490.869539:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788940490.869551:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788940490.869563:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788940490.869574:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1788940490.869595:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000953f4e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944761344:0@lo:502: 00000100:00100000:0.0:1788940490.869700:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940490.869729:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000266293ef going to sleep for 11 seconds 00000100:00100000:1.0:1788940490.869916:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944761344 00000100:00100000:1.0:1788940490.869922:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944761344 00000100:00100000:1.0:1788940490.869964:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788940490.869970:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067e6f1c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:7450:x1875839944761344:12345-0@lo:502: 00000100:00100000:1.0:1788940490.870174:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067e6f1c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:7450:x1875839944761344:12345-0@lo:502: Request processed in 203us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940490.870181:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788940490.870358:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000953f4e5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944761344:0@lo:502: 00000040:00080000:0.0:1788940490.870409:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788940490.870418:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788940490.870921:0:7468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788940490.870946:0:7468:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000000e8c079) 00000020:00000080:0.0:1788940490.870969:0:7468:0:(obd_config.c:786:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788940490.871129:0:7468:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000006759060 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788940490.871134:0:7468:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000006759060 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788940490.871136:0:7468:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000006759060 3 00010000:00080000:0.0:1788940490.871169:0:7468:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003e9cc1cd@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:0.0:1788940490.874413:0:7468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1788940490.874716:0:7468:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788940490.874765:0:7468:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788940490.874803:0:7468:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x9c34acc08badcdff 00000100:00080000:0.0:1788940490.874814:0:7468:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788940490.874820:0:7468:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000003e9cc1cd using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1788940490.874856:0:7468:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000953f4e5 x1875839944761472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788940490.874888:0:7468:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788940490.875146:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000953f4e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875839944761472:0@lo:38: 00000100:00100000:1.0:1788940490.875218:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788940490.875579:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1788940490.875633:0:7450:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788940490.875659:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788940490.875669:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 0000000013dbbeea/0x9c34acc08badcdea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcdf1 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940490.875679:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 0000000013dbbeea/0x9c34acc08badcdea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcdf1 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788940490.875721:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788940490.875723:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788940490.875724:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940490.875725:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940490.875726:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940490.875727:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940490.875729:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788940490.875730:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788940490.875731:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788940490.875732:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940490.875734:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788940490.875737:0:7450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1788940490.875740:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788940490.875741:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788940490.875742:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940490.875743:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940490.875744:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940490.875745:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940490.875746:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788940490.875747:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788940490.875748:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788940490.875749:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940490.875750:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788940490.875765:0:7450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788940490.875775:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f66f2c09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944761600:0@lo:253: 40000000:00080000:2.0:1788940490.875912:0:7469:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:1.0:1788940490.876104:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.876135:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000171a4445 going to sleep for 11 seconds 00000100:00100000:2.0:1788940490.876205:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944761600 00000100:00100000:2.0:1788940490.876212:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944761600 00000100:00100000:2.0:1788940490.876249:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788940490.876280:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002658173d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:7450:x1875839944761600:12345-0@lo:253: 20000000:01000000:2.0:1788940490.876304:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788940490.876317:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788940490.876544:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944761472 00000100:00100000:0.0:1788940490.876548:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944761472 00000100:00100000:0.0:1788940490.876575:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940490.876580:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055ef1786 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875839944761472:12345-0@lo:38: 00010000:00080000:0.0:1788940490.876597:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1788940490.876635:0:6522:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x9c34acc08badce06 00000004:00100000:0.0:1788940490.876649:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788940490.876682:0:6522:0:(import.c:65:import_set_state_nolock()) 0000000090ab3a55 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940490.876735:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055ef1786 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875839944761472:12345-0@lo:38: Request processed in 154us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940490.876741:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788940490.876952:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000953f4e5 x1875839944761472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940490.876963:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788940490.876970:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788940490.876976:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788940490.876980:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788940490.876982:0:3644:0:(import.c:65:import_set_state_nolock()) 000000003e9cc1cd lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788940490.876987:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000953f4e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875839944761472:0@lo:38: 00000001:00100000:0.0:1788940490.879233:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788940490.886762:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788940490.886885:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788940490.888099:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002658173d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:7450:x1875839944761600:12345-0@lo:253: Request processed in 11839us (11991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.888123:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788940490.888312:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f66f2c09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:7450:1875839944761600:0@lo:253: 10000000:01000000:3.0:1788940490.888326:0:7450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788940490.888330:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788940490.888332:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788940490.888334:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940490.888335:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940490.888336:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940490.888337:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940490.888338:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788940490.888340:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788940490.888341:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788940490.888343:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940490.888344:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788940490.888359:0:7450:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788940490.890082:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788940490.890093:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788940490.890115:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e066b587/0x9c34acc08badce0d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940490.890148:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a8be9634/0x9c34acc08badcd2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcd26 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940490.890156:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcdce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcdc7 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940490.890163:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e066b587/0x9c34acc08badce0d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940490.890202:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcdce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badcdc7 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940490.890216:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcdce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badcdc7 expref: 14 pid: 6512 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940490.890230:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082a4905c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875839944761728:0@lo:104: 00000100:00100000:0.0:1788940490.890748:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788940490.890907:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a8be9634/0x9c34acc08badcd2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badcd26 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940490.890916:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a8be9634/0x9c34acc08badcd2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badcd26 expref: 14 pid: 6512 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940490.890925:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003230586a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875839944761856:0@lo:104: 00000100:00100000:0.0:1788940490.890948:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:3.0:1788940490.894391:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1788940490.894568:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788940490.895046:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788940490.895249:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788940490.895459:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788940490.895621:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:0.0:1788940490.896679:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set 000000006d451425 going to sleep for 11 seconds 00000100:00100000:1.0:1788940490.896899:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944761728 00000100:00100000:1.0:1788940490.896909:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944761728 00000100:00100000:3.0:1788940490.896962:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944761856 00000100:00100000:3.0:1788940490.896966:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944761856 00000100:00100000:3.0:1788940490.896987:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940490.896994:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd1285e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:6536:x1875839944761728:12345-0@lo:104: 00010000:00010000:3.0:1788940490.897081:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: 0000000060e8b36b/0x9c34acc08badcdc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcdce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.897168:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940490.897174:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd1285e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:6536:x1875839944761728:12345-0@lo:104: Request processed in 180us (6427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940490.897191:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940490.897207:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940490.897213:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c71906a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:6536:x1875839944761856:12345-0@lo:104: 00010000:00010000:3.0:1788940490.897220:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: 0000000061758466/0x9c34acc08badcd26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcd2d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.897274:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788940490.897279:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c71906a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:6536:x1875839944761856:12345-0@lo:104: Request processed in 67us (6331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940490.897284:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788940490.897301:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940490.897307:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: 0000000060e8b36b/0x9c34acc08badcdc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcdce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.897314:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000060e8b36b already unused, calling callback (000000009553f981) 10000000:00010000:3.0:1788940490.897317:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: 0000000060e8b36b/0x9c34acc08badcdc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcdce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.897324:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: 0000000060e8b36b/0x9c34acc08badcdc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcdce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940490.897330:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: 0000000060e8b36b/0x9c34acc08badcdc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcdce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940490.897336:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940490.897368:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: 0000000060e8b36b/0x9c34acc08badcdc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcdce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.897374:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940490.897393:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: 0000000060e8b36b/0x9c34acc08badcdc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcdce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.897399:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: 0000000060e8b36b/0x9c34acc08badcdc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcdce expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.897412:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940490.897414:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: 0000000061758466/0x9c34acc08badcd26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcd2d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.897419:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000061758466 already unused, calling callback (000000009553f981) 10000000:00010000:3.0:1788940490.897421:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: 0000000061758466/0x9c34acc08badcd26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcd2d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.897426:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: 0000000061758466/0x9c34acc08badcd26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcd2d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940490.897431:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: 0000000061758466/0x9c34acc08badcd26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcd2d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940490.897436:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940490.897447:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: 0000000061758466/0x9c34acc08badcd26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcd2d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.897453:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940490.897468:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: 0000000061758466/0x9c34acc08badcd26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcd2d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.897474:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: 0000000061758466/0x9c34acc08badcd26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcd2d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940490.897488:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940490.897495:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940490.897496:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940490.897542:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940490.897592:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063a3e2ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944761984:0@lo:103: 00000100:00100000:0.0:1788940490.897701:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940490.897795:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940490.897801:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dba4c323 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944762112:0@lo:103: 00000100:00100000:0.0:1788940490.897820:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:3.0:1788940490.898557:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788940490.898974:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788940490.899196:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1788940490.899371:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788940490.899547:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1788940490.899760:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000100:00100000:1.0:1788940490.900112:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082a4905c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875839944761728:0@lo:104: 00000100:00100000:1.0:1788940490.900126:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003230586a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875839944761856:0@lo:104: 00010000:00010000:1.0:1788940490.900154:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e066b587/0x9c34acc08badce0d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940490.902391:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944761984 00000100:00100000:2.0:1788940490.902405:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944761984 00010000:00010000:2.0:1788940490.902438:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcdce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcdc7 expref: 15 pid: 6512 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940490.902478:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944762112 00000100:00100000:2.0:1788940490.902482:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944762112 00010000:00010000:2.0:1788940490.902493:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a8be9634/0x9c34acc08badcd2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcd26 expref: 16 pid: 6512 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940490.902508:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940490.902516:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd1947dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:3648:x1875839944761984:12345-0@lo:103: 00010000:00010000:2.0:1788940490.902530:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940490.902535:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcdce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcdc7 expref: 16 pid: 6512 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.902546:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcdce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badcdc7 expref: 16 pid: 6512 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.902561:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008a05d1f7/0x9c34acc08badcdce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badcdc7 expref: 16 pid: 6512 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.902574:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940490.902890:0:6507:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788940490.902899:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788940490.902964:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd1947dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:3648:x1875839944761984:12345-0@lo:103: Request processed in 448us (5262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.902972:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940490.902990:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788940490.902997:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042ebb0a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:3646:x1875839944762112:12345-0@lo:103: 00000100:00100000:0.0:1788940490.903305:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063a3e2ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944761984:0@lo:103: 00010000:00010000:2.0:1788940490.903469:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940490.903473:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a8be9634/0x9c34acc08badcd2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcd26 expref: 14 pid: 6512 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.903484:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a8be9634/0x9c34acc08badcd2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badcd26 expref: 14 pid: 6512 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.903495:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a8be9634/0x9c34acc08badcd2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badcd26 expref: 14 pid: 6512 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.903506:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e066b587/0x9c34acc08badce0d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.903514:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e066b587/0x9c34acc08badce0d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788940490.903528:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013436003s 00010000:00010000:2.0:1788940490.903532:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e066b587/0x9c34acc08badce0d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.903538:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e066b587/0x9c34acc08badce0d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.903544:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e066b587/0x9c34acc08badce0d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.903549:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e066b587/0x9c34acc08badce0d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.903555:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e066b587 already unused, calling callback (000000007b9d4142) 00010000:00010000:2.0:1788940490.903558:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e066b587/0x9c34acc08badce0d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.903569:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e066b587/0x9c34acc08badce0d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.903587:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e066b587/0x9c34acc08badce0d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940490.903598:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000040:01000000:1.0:1788940490.903771:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00010000:00010000:0.0:1788940490.904094:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e066b587/0x9c34acc08badce0d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940490.904103:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e066b587/0x9c34acc08badce0d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940490.904109:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e066b587/0x9c34acc08badce0d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788940490.904126:0:7473:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788940490.904130:0:7473:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788940490.904220:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042ebb0a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+13:3646:x1875839944762112:12345-0@lo:103: Request processed in 1223us (6397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.904229:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940490.904372:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dba4c323 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944762112:0@lo:103: 00000040:01000000:0.0:1788940490.907887:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1788940490.907951:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000985312e5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1875839944762240:0@lo:700: 00000100:00100000:0.0:1788940490.908025:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940490.908059:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc9ee695 going to sleep for 11 seconds 00000040:01000000:1.0:1788940490.908178:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788940490.908594:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0a08df1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875839944762368:0@lo:1000: 00000040:01000000:0.0:1788940490.909320:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788940490.909426:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788940490.909785:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.909876:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944762368 00000100:00100000:1.0:1788940490.909885:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944762368 00000100:00100000:1.0:1788940490.909930:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940490.909937:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d35a0dd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1875839944762368:12345-0@lo:1000: 00000100:00100000:1.0:1788940490.910090:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d35a0dd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1875839944762368:12345-0@lo:1000: Request processed in 153us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940490.910098:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940490.910138:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 00000000798c72fc going to sleep for 11 seconds 00000100:00100000:1.0:1788940490.910165:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0a08df1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875839944762368:0@lo:1000: 00000040:01000000:1.0:1788940490.910193:0:7476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1788940490.910220:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0a08df1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875839944762496:0@lo:700: 00000100:00100000:1.0:1788940490.910277:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.910295:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a89c8a68 going to sleep for 11 seconds 00000100:00100000:2.0:1788940490.910779:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944762240 00000100:00100000:2.0:1788940490.910785:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944762240 00000100:00100000:2.0:1788940490.910895:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940490.910902:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f258214 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1875839944762240:12345-0@lo:700: 00000004:00000080:0.0:1788940490.911204:0:7450:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788940490.911215:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788940490.911459:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788940490.911988:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944762496 00000100:00100000:1.0:1788940490.911996:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944762496 00000100:00100000:1.0:1788940490.912111:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940490.912118:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d018b82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1875839944762496:12345-0@lo:700: 00000100:00100000:1.0:1788940490.912196:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d018b82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1875839944762496:12345-0@lo:700: Request processed in 79us (1919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940490.912203:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940490.912462:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0a08df1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875839944762496:0@lo:700: 00000100:00100000:3.0:1788940490.912534:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dba4c323 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1875839944762624:0@lo:900: 00000100:00100000:3.0:1788940490.912576:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940490.912619:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944762624 00000100:00100000:3.0:1788940490.912624:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944762624 00000100:00100000:3.0:1788940490.912932:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940490.912941:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ad8ccee pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1875839944762624:12345-0@lo:900: 00000100:00100000:3.0:1788940490.912977:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ad8ccee pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1875839944762624:12345-0@lo:900: Request processed in 38us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940490.912983:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1788940490.914061:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788940490.914650:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788940490.914684:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 40000000:02000000:2.0:1788940490.916736:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:0.0:1788940490.917736:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788940490.918162:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788940490.918900:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788940490.919968:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788940490.921111:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788940490.921372:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788940490.921545:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788940490.921706:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788940490.923496:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788940490.924146:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00000100:00100000:3.0:1788940490.924929:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c4e8bfe going to sleep for 11 seconds 00010000:00080000:3.0:1788940490.924972:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dba4c323 x1875839944762624/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788940506 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940490.924989:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dba4c323 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1875839944762624:0@lo:900: 00100000:10000000:0.0:1788940490.925206:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788940490.925377:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788940490.925514:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000100:00100000:2.0:1788940490.926353:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f258214 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1875839944762240:12345-0@lo:700: Request processed in 15448us (18323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940490.926366:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:0.0:1788940490.926870:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00000100:00100000:3.0:1788940490.927226:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dba4c323 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875839944762752:0@lo:1000: 00000100:00100000:3.0:1788940490.927301:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940490.927349:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944762752 00000100:00100000:3.0:1788940490.927358:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944762752 00000100:00100000:3.0:1788940490.927401:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940490.927408:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d19d7b0c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1875839944762752:12345-0@lo:1000: 00000100:00100000:3.0:1788940490.927475:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d19d7b0c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1875839944762752:12345-0@lo:1000: Request processed in 67us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940490.927482:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940490.927511:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b72bc795 going to sleep for 11 seconds 00000100:00100000:3.0:1788940490.927536:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dba4c323 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875839944762752:0@lo:1000: 00000004:00080000:3.0:1788940490.927581:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000001c4e8bfe with version 0 00000020:00100000:3.0:1788940490.927594:0:7476:0:(genops.c:2436:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788940490.927600:0:7476:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000dba4c323 x1875839944763008/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940490.927613:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dba4c323 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875839944763008:0@lo:1000: 00010000:00080000:2.0:1788940490.927935:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000985312e5 x1875839944762240/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788940506 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940490.927945:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000985312e5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1875839944762240:0@lo:700: 40000000:02000000:2.0:1788940490.927952:0:7475:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:3.0:1788940490.928092:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940490.928116:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944763008 00000100:00100000:3.0:1788940490.928120:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944763008 00000100:00100000:3.0:1788940490.928147:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940490.928152:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002f4b666 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1875839944763008:12345-0@lo:1000: 00000100:00100000:3.0:1788940490.928483:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 00000000763c789e going to sleep for 11 seconds 00100000:10000000:0.0:1788940490.928953:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788940490.929191:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788940490.929371:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788940490.929517:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000001:00080000:3.0:1788940490.934211:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1788940490.934348:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002f4b666 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1875839944763008:12345-0@lo:1000: Request processed in 6192us (6252us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788940490.934359:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1788940490.934464:0:7476:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788940490.934470:0:7476:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788940490.934485:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dba4c323 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875839944763008:0@lo:1000: 00000100:00100000:1.0:1788940490.934566:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000461253f6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875839944763136:0@lo:1000: 00000100:00100000:1.0:1788940490.934602:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940490.934893:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a89c8a68 going to sleep for 11 seconds 00000100:00100000:3.0:1788940490.934952:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944763136 00000100:00100000:3.0:1788940490.934958:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944763136 00000100:00100000:3.0:1788940490.934994:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940490.935064:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000347a1a2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1875839944763136:12345-0@lo:1000: 00000100:00100000:3.0:1788940490.935152:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000347a1a2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1875839944763136:12345-0@lo:1000: Request processed in 151us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940490.935159:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940490.935309:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000461253f6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875839944763136:0@lo:1000: 00000040:00080000:1.0:1788940490.935328:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788940490.935357:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000f7724a0a with version 1 00000004:00080000:3.0:1788940490.936115:0:7464:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000ec3eb1f7 version 1 rpc_version 1 00000020:00100000:3.0:1788940490.936139:0:7464:0:(genops.c:2436:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788940490.936147:0:7464:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000b8edac48 x1875839944763392/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940490.936165:0:7464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8edac48 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1875839944763392:0@lo:1000: 00000100:00100000:3.0:1788940490.936204:0:7464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940490.936223:0:7464:0:(client.c:2716:ptlrpc_set_wait()) set 000000000264a5f3 going to sleep for 11 seconds 00000100:00100000:3.0:1788940490.936240:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944763392 00000100:00100000:3.0:1788940490.936244:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944763392 00000100:00100000:3.0:1788940490.936289:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940490.936295:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088d5b5e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7464:x1875839944763392:12345-0@lo:1000: 00100000:10000000:0.0:1788940490.936760:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788940490.937539:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788940490.938750:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788940490.941884:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788940490.943161:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788940490.943345:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788940490.943474:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788940490.943602:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00000001:00080000:3.0:1788940490.945799:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1788940490.945936:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088d5b5e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7464:x1875839944763392:12345-0@lo:1000: Request processed in 9637us (9728us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788940490.945950:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1788940490.946017:0:7464:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1788940490.946022:0:7464:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788940490.946040:0:7464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8edac48 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1875839944763392:0@lo:1000: 00100000:10000000:0.0:1788940490.946295:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00000040:00080000:1.0:1788940490.946718:0:7476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788940490.946785:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:0.0:1788940490.948247:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788940490.948471:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788940490.949139:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788940490.949327:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788940490.949474:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788940490.949602:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788940490.949714:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788940490.949925:0:7450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1788940490.956539:0:7450:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788940490.956583:0:7450:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9d5841a37988 00100000:10000000:0.0:1788940490.956592:0:7450:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788940490.960404:0:7450:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788940490.960442:0:7450:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788940490.960461:0:7450:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788940490.960490:0:7450:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788940490.961407:0:7450:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788940490.961603:0:7450:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1788940490.996663:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940491.001390:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788940491.001465:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 1, retries 0 00000004:00080000:3.0:1788940491.001469:0:7475:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1788940491.035866:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940492.060184:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940493.083390:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940494.116416:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940495.131410:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940496.027445:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940496.027472:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be42d8da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944763520:0@lo:41: 00000100:00100000:0.0:1788940496.027671:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940496.027819:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944763520 00000100:00100000:0.0:1788940496.027830:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944763520 00000100:00100000:0.0:1788940496.027944:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788940496.027952:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1c1d50b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944763520:12345-0@lo:41: 00000004:00000024:0.0:1788940496.027988:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788940496.028054:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1c1d50b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944763520:12345-0@lo:41: Request processed in 102us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940496.028062:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788940496.028125:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be42d8da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944763520:0@lo:41: 00000100:00100000:2.0:1788940496.033223:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940496.033244:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efa1e6b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944763904:0@lo:400: 00000100:00100000:2.0:1788940496.033331:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940496.033493:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f68f045f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944763648:0@lo:400: 00000100:00100000:0.0:1788940496.033530:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940496.033561:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940496.033566:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e801e57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944763776:0@lo:400: 00000100:00100000:0.0:1788940496.033603:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940496.033638:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944763904 00000100:00100000:0.0:1788940496.033646:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944763904 00000100:00100000:0.0:1788940496.033795:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944763776 00000100:00100000:0.0:1788940496.033800:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944763776 00000100:00100000:0.0:1788940496.033824:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940496.033832:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c00810f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944763904:12345-0@lo:400: 00000100:00100000:0.0:1788940496.033957:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c00810f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944763904:12345-0@lo:400: Request processed in 126us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940496.033966:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940496.033993:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788940496.034000:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be42d8da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944763776:12345-0@lo:400: 00000100:00100000:0.0:1788940496.034043:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be42d8da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944763776:12345-0@lo:400: Request processed in 45us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940496.034049:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788940496.034087:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007e801e57 x1875839944763776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940496.034101:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e801e57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944763776:0@lo:400: 00010000:00080000:0.0:1788940496.034127:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000efa1e6b4 x1875839944763904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940496.034135:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efa1e6b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944763904:0@lo:400: 00000100:00100000:2.0:1788940496.034205:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944763648 00000100:00100000:2.0:1788940496.034209:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944763648 00000100:00100000:2.0:1788940496.034250:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788940496.034282:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032406812 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+13:3647:x1875839944763648:12345-0@lo:400: 00000100:00100000:2.0:1788940496.034318:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032406812 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+13:3647:x1875839944763648:12345-0@lo:400: Request processed in 63us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940496.034325:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788940496.035724:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f68f045f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944763648:0@lo:400: 00000001:02000400:0.0:1788940496.080549:0:7721:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788940496.158900:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788940497.178603:0:7773:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788940497.179073:0:7773:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788940497.185290:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788940497.563341:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788940497.563350:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d034739000 from 4 10000000:01000000:3.0:1788940497.563369:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788940497.563428:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badce14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940497.563441:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badce14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940497.563452:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badce14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940497.563477:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8edac48 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944764032:0@lo:101: 00000100:00100000:3.0:1788940497.563682:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940497.563739:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944764032 00000100:00100000:0.0:1788940497.563749:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944764032 00000100:00100000:3.0:1788940497.563752:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a41003c2 going to sleep for 11 seconds 00000100:00100000:0.0:1788940497.563807:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788940497.563816:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f95d50cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+13:6517:x1875839944764032:12345-0@lo:101: 00010000:00010000:0.0:1788940497.563831:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940497.563843:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e066b587/0x9c34acc08badce1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badce14 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940497.563867:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e066b587/0x9c34acc08badce1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badce14 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940497.563877:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e066b587/0x9c34acc08badce1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badce14 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940497.563886:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e066b587, rc 0) 00000100:00100000:0.0:1788940497.563938:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f95d50cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:6517:x1875839944764032:12345-0@lo:101: Request processed in 124us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940497.563945:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788940497.564059:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8edac48 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944764032:0@lo:101: 00010000:00010000:1.0:1788940497.564089:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badce14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce1b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940497.564097:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badce14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badce1b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940497.564149:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000461253f6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944764160:0@lo:256: 00000100:00100000:1.0:1788940497.564180:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940497.564190:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000007334878e going to sleep for 11 seconds 00000100:00100000:0.0:1788940497.564250:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944764160 00000100:00100000:0.0:1788940497.564254:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944764160 00000100:00100000:0.0:1788940497.564294:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788940497.564299:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7898c17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:6517:x1875839944764160:12345-0@lo:256: 20000000:01000000:0.0:1788940497.564313:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788940497.564329:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788940497.564332:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788940497.564410:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7898c17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:6517:x1875839944764160:12345-0@lo:256: Request processed in 111us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940497.564417:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788940497.564492:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000461253f6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944764160:0@lo:256: 10000000:01000000:3.0:1788940497.564894:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788940497.564903:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badce14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce1b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940497.564913:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 00000000c38d8ba8/0x9c34acc08badce14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce1b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940497.564925:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788940497.564927:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91d004f4a000 from 21 10000000:01000000:3.0:1788940497.564929:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788940497.564948:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badce22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940497.564954:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badce22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940497.564972:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badce22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940497.564984:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063a3e2ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944764288:0@lo:101: 00000100:00100000:3.0:1788940497.565023:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940497.565054:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b85209e2 going to sleep for 11 seconds 00000100:00100000:0.0:1788940497.565310:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944764288 00000100:00100000:0.0:1788940497.565315:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944764288 00000100:00100000:0.0:1788940497.565340:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788940497.565345:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2199084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:6517:x1875839944764288:12345-0@lo:101: 00010000:00010000:0.0:1788940497.565355:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940497.565364:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000010be789b/0x9c34acc08badce29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badce22 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940497.565379:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010be789b/0x9c34acc08badce29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badce22 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940497.565388:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000010be789b/0x9c34acc08badce29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badce22 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940497.565395:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000010be789b, rc 0) 00000100:00100000:0.0:1788940497.565426:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2199084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:6517:x1875839944764288:12345-0@lo:101: Request processed in 81us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940497.565432:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788940497.565734:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063a3e2ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944764288:0@lo:101: 00010000:00010000:3.0:1788940497.565746:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badce22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce29 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940497.565753:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badce22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badce29 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940497.565802:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063a3e2ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944764416:0@lo:501: 00000100:00100000:3.0:1788940497.565834:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940497.565856:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b85209e2 going to sleep for 11 seconds 00000100:00100000:1.0:1788940497.569073:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944764416 00000100:00100000:1.0:1788940497.569088:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944764416 00000100:00100000:1.0:1788940497.569152:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788940497.569159:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000793220c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:6517:x1875839944764416:12345-0@lo:501: 00000100:00100000:1.0:1788940497.569377:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000793220c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:6517:x1875839944764416:12345-0@lo:501: Request processed in 217us (3552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940497.569386:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788940497.569502:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063a3e2ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944764416:0@lo:501: 00000100:00100000:0.0:1788940497.569853:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f3db377b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944764544:0@lo:503: 00000100:00100000:0.0:1788940497.569907:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940497.569945:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d276d4de going to sleep for 11 seconds 00000100:00100000:1.0:1788940497.570045:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944764544 00000100:00100000:1.0:1788940497.570051:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944764544 00000100:00100000:1.0:1788940497.570081:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788940497.570087:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbd0f571 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:6517:x1875839944764544:12345-0@lo:503: 00000100:00100000:1.0:1788940497.570178:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbd0f571 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:6517:x1875839944764544:12345-0@lo:503: Request processed in 90us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940497.570184:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788940497.570304:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f3db377b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944764544:0@lo:503: 00000100:00100000:0.0:1788940497.571159:0:7793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000dd08398 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:7793:1875839944764672:0@lo:502: 00000100:00100000:0.0:1788940497.571211:0:7793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940497.571235:0:7793:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef871f9d going to sleep for 11 seconds 00000100:00100000:1.0:1788940497.571661:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944764672 00000100:00100000:1.0:1788940497.571668:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944764672 00000100:00100000:1.0:1788940497.571709:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788940497.571717:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006db7c9d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:7793:x1875839944764672:12345-0@lo:502: 00000100:00100000:1.0:1788940497.571845:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006db7c9d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:7793:x1875839944764672:12345-0@lo:502: Request processed in 129us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940497.571852:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788940497.572075:0:7793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000dd08398 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:7793:1875839944764672:0@lo:502: 00000100:00100000:2.0:1788940497.572132:0:7793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d52bc761 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:7793:1875839944764800:0@lo:502: 00000100:00100000:2.0:1788940497.572171:0:7793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940497.572203:0:7793:0:(client.c:2716:ptlrpc_set_wait()) set 000000000264a5f3 going to sleep for 11 seconds 00000100:00100000:0.0:1788940497.572669:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944764800 00000100:00100000:0.0:1788940497.572676:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944764800 00000100:00100000:0.0:1788940497.572769:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788940497.572776:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b3f8718 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:7793:x1875839944764800:12345-0@lo:502: 00000100:00100000:0.0:1788940497.572889:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b3f8718 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:7793:x1875839944764800:12345-0@lo:502: Request processed in 114us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940497.572896:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788940497.572980:0:7793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d52bc761 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:7793:1875839944764800:0@lo:502: 00000040:00080000:3.0:1788940497.573003:0:7793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788940497.573086:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788940497.573108:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788940497.573116:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badce22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce29 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940497.573127:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 00000000b681abb9/0x9c34acc08badce22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce29 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940497.573141:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788940497.573143:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d004f4a000 from 4 10000000:01000000:3.0:1788940497.573145:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788940497.573168:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badce30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940497.573175:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badce30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940497.573183:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badce30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940497.573197:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000011dd820 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944764928:0@lo:101: 00000100:00100000:3.0:1788940497.573225:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940497.574153:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000033d4ba1e going to sleep for 11 seconds 00000100:00100000:1.0:1788940497.574384:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944764928 00000100:00100000:1.0:1788940497.574394:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944764928 00000100:00100000:1.0:1788940497.574438:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788940497.574444:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7b1a979 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:6517:x1875839944764928:12345-0@lo:101: 00010000:00010000:1.0:1788940497.574457:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940497.574470:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b6d46e38/0x9c34acc08badce37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badce30 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940497.574492:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b6d46e38/0x9c34acc08badce37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badce30 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940497.574501:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b6d46e38/0x9c34acc08badce37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badce30 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940497.574509:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b6d46e38, rc 0) 00000100:00100000:1.0:1788940497.574953:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7b1a979 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944764928:12345-0@lo:101: Request processed in 508us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940497.574960:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788940497.575032:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000011dd820 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944764928:0@lo:101: 00010000:00010000:3.0:1788940497.575046:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badce30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce37 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940497.575055:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badce30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badce37 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940497.575114:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000011dd820 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944765056:0@lo:256: 00000100:00100000:3.0:1788940497.575148:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940497.575211:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000033d4ba1e going to sleep for 11 seconds 00000100:00100000:2.0:1788940497.575241:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944765056 00000100:00100000:2.0:1788940497.575334:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944765056 00000100:00100000:0.0:1788940497.575556:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788940497.575838:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c29df64b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944765056:12345-0@lo:256: 20000000:01000000:0.0:1788940497.575860:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788940497.575875:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788940497.575879:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788940497.576002:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c29df64b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944765056:12345-0@lo:256: Request processed in 160us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940497.576018:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788940497.576160:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000011dd820 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944765056:0@lo:256: 10000000:01000000:1.0:1788940497.576218:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788940497.576231:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badce30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce37 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940497.576241:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 000000006c81f3d6/0x9c34acc08badce30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce37 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940497.576288:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788940497.576291:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788940497.576294:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788940497.576323:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000a0c5de69/0x9c34acc08badce3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940497.576330:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000a0c5de69/0x9c34acc08badce3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940497.576338:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000a0c5de69/0x9c34acc08badce3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940497.576360:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c564212 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944765184:0@lo:101: 00000100:00100000:1.0:1788940497.576401:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940497.576441:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f94a6c60 going to sleep for 11 seconds 00000100:00100000:0.0:1788940497.576890:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944765184 00000100:00100000:0.0:1788940497.576896:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944765184 00000100:00100000:0.0:1788940497.576967:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788940497.576974:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7c770f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944765184:12345-0@lo:101: 00010000:00010000:0.0:1788940497.576985:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940497.576997:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000095eac462/0x9c34acc08badce45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badce3e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940497.577028:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000095eac462/0x9c34acc08badce45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badce3e expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940497.577039:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000095eac462/0x9c34acc08badce45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badce3e expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940497.577065:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000095eac462, rc 0) 00000100:00100000:0.0:1788940497.577161:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7c770f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944765184:12345-0@lo:101: Request processed in 188us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940497.577167:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788940497.581366:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c564212 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944765184:0@lo:101: 00010000:00010000:2.0:1788940497.581396:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000a0c5de69/0x9c34acc08badce3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce45 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940497.581508:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000a0c5de69/0x9c34acc08badce3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badce45 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940497.582004:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9482c4b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944765312:0@lo:501: 00000100:00100000:3.0:1788940497.582083:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940497.582182:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037342811 going to sleep for 11 seconds 00000100:00100000:1.0:1788940497.582221:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944765312 00000100:00100000:1.0:1788940497.582229:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944765312 00000100:00100000:1.0:1788940497.583041:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788940497.583056:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bf1ea8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944765312:12345-0@lo:501: 00000100:00100000:1.0:1788940497.583221:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bf1ea8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944765312:12345-0@lo:501: Request processed in 169us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940497.583229:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788940497.584062:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9482c4b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944765312:0@lo:501: 00000100:00100000:3.0:1788940497.584135:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9482c4b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944765440:0@lo:503: 00000100:00100000:3.0:1788940497.584205:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940497.584455:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037342811 going to sleep for 11 seconds 00000100:00100000:2.0:1788940497.584902:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944765440 00000100:00100000:2.0:1788940497.584917:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944765440 00000100:00100000:2.0:1788940497.584984:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788940497.584992:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fe96363 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944765440:12345-0@lo:503: 00000100:00100000:2.0:1788940497.585157:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fe96363 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944765440:12345-0@lo:503: Request processed in 165us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940497.585171:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788940497.585556:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9482c4b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944765440:0@lo:503: 00000100:00100000:3.0:1788940497.586985:0:7794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9482c4b pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:7794:1875839944765568:0@lo:502: 00000100:00100000:3.0:1788940497.587087:0:7794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940497.587147:0:7794:0:(client.c:2716:ptlrpc_set_wait()) set 000000007838f286 going to sleep for 11 seconds 00000100:00100000:2.0:1788940497.587217:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944765568 00000100:00100000:2.0:1788940497.587233:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944765568 00000100:00100000:2.0:1788940497.587300:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788940497.587308:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069ebdd8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:7794:x1875839944765568:12345-0@lo:502: 00000100:00100000:2.0:1788940497.587502:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069ebdd8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:7794:x1875839944765568:12345-0@lo:502: Request processed in 195us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940497.587510:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788940497.587901:0:7794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9482c4b pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:7794:1875839944765568:0@lo:502: 00000020:01000000:3.0:1788940497.587933:0:7794:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940497.587946:0:7794:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940497.587949:0:7794:0:(obd_config.c:1662:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788940497.587953:0:7794:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788940497.587957:0:7794:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:00000080:3.0:1788940497.587982:0:7794:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788940497.587997:0:7794:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000da3f1c05) 00000020:00000080:3.0:1788940497.588030:0:7794:0:(obd_config.c:786:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1788940497.588037:0:7794:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788940497.588119:0:7794:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788940497.588124:0:7794:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788940497.588131:0:7794:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08badce53 00010000:00080000:3.0:1788940497.588163:0:7794:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000291ea1ee@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:3.0:1788940497.591216:0:7794:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1788940497.592920:0:7794:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788940497.592941:0:7794:0:(obd_config.c:1571:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788940497.592982:0:7794:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788940497.593020:0:7794:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08badce5a 00000100:00080000:1.0:1788940497.593036:0:7794:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788940497.593041:0:7794:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000291ea1ee using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940497.593097:0:7794:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000eb0f48fc x1875839944765696/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940497.593132:0:7794:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1788940497.593244:0:7794:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1788940497.593873:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb0f48fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944765696:0@lo:38: 00000100:00100000:2.0:1788940497.593951:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940497.594188:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944765696 00000100:00100000:1.0:1788940497.594196:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944765696 00000100:00100000:1.0:1788940497.594235:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940497.594242:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050336efa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875839944765696:12345-0@lo:38: 00010000:00080000:1.0:1788940497.594288:0:6526:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:1.0:1788940497.594325:0:6526:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08badce61 00000004:00100000:1.0:1788940497.594340:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788940497.594346:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788940497.594928:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049c647d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944765824:0@lo:400: 00000100:00100000:0.0:1788940497.594974:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940497.595085:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008478e8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944765952:0@lo:400: 00000100:00100000:0.0:1788940497.595112:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940497.595137:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940497.595143:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c564212 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944766080:0@lo:400: 00000100:00100000:0.0:1788940497.595163:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940497.595196:0:6525:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788940497.595205:0:6525:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788940497.596042:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944765952 00000100:00100000:0.0:1788940497.596051:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944765952 00000100:00100000:3.0:1788940497.596185:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788940497.596193:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3db377b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944765952:12345-0@lo:400: 00000100:00100000:2.0:1788940497.596310:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944765824 00000100:00100000:2.0:1788940497.596314:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944765824 00000100:00100000:3.0:1788940497.596384:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3db377b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944765952:12345-0@lo:400: Request processed in 192us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940497.596392:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788940497.596455:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944766080 00000100:00100000:3.0:1788940497.596458:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944766080 00000100:00100000:3.0:1788940497.596471:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940497.596476:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000dd08398 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944765824:12345-0@lo:400: 00000100:00100000:3.0:1788940497.596509:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000dd08398 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944765824:12345-0@lo:400: Request processed in 33us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940497.596515:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940497.596525:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940497.596838:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000985312e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944766080:12345-0@lo:400: 00000100:00100000:3.0:1788940497.596872:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000985312e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944766080:12345-0@lo:400: Request processed in 343us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940497.596879:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788940497.597154:0:7797:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000080ff6b08 x1875839944766208/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940497.597165:0:7797:0:(client.c:2716:ptlrpc_set_wait()) set 000000000264a5f3 going to sleep for 0 seconds 00000020:01000000:1.0:1788940497.597293:0:7794:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940497.597300:0:7794:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940497.597303:0:7794:0:(obd_config.c:1662:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788940497.597306:0:7794:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940497.597311:0:7794:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940497.597312:0:7794:0:(obd_config.c:1662:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788940497.597315:0:7794:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788940497.597317:0:7794:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788940497.597339:0:7794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000461253f6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:7794:1875839944766336:0@lo:502: 00000100:00100000:1.0:1788940497.597391:0:7794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940497.597524:0:7794:0:(client.c:2716:ptlrpc_set_wait()) set 000000002752cd78 going to sleep for 11 seconds 00000100:00100000:0.0:1788940497.597918:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008478e8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944765952:0@lo:400: 00010000:00080000:0.0:1788940497.597946:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008c564212 x1875839944766080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940497.597956:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c564212 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944766080:0@lo:400: 00010000:00080000:0.0:1788940497.597983:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000049c647d7 x1875839944765824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940497.597992:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049c647d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944765824:0@lo:400: 00000100:00100000:2.0:1788940497.598050:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944766336 00000100:00100000:2.0:1788940497.598055:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944766336 00000100:00100000:3.0:1788940497.598196:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788940497.598205:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003437eb4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:7794:x1875839944766336:12345-0@lo:502: 00000100:00100000:3.0:1788940497.598376:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003437eb4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:7794:x1875839944766336:12345-0@lo:502: Request processed in 172us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940497.598384:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788940497.598589:0:7794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000461253f6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:7794:1875839944766336:0@lo:502: 00000020:01000000:2.0:1788940497.598612:0:7794:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940497.598618:0:7794:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940497.598620:0:7794:0:(obd_config.c:1662:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788940497.598624:0:7794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1788940497.598842:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788940497.598862:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788940497.598870:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000a0c5de69/0x9c34acc08badce3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce45 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940497.598894:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 00000000a0c5de69/0x9c34acc08badce3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce45 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940497.598905:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788940497.598907:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91d00509b3b0 from 1 10000000:01000000:0.0:1788940497.598910:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788940497.598943:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000363cf4d7/0x9c34acc08badce68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940497.598949:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000363cf4d7/0x9c34acc08badce68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940497.598957:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000363cf4d7/0x9c34acc08badce68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940497.598975:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd1947dd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944766464:0@lo:101: 00000100:00100000:0.0:1788940497.599022:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940497.599870:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b4a8c8d going to sleep for 11 seconds 00000100:00100000:1.0:1788940497.599952:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944766464 00000100:00100000:1.0:1788940497.599960:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944766464 00000100:00100000:0.0:1788940497.600299:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788940497.600307:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000d8c304 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944766464:12345-0@lo:101: 00010000:00010000:0.0:1788940497.600321:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940497.600352:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004ab13d23/0x9c34acc08badce6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badce68 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940497.600379:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ab13d23/0x9c34acc08badce6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badce68 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940497.600390:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004ab13d23/0x9c34acc08badce6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badce68 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940497.600404:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004ab13d23, rc 0) 00000100:00100000:0.0:1788940497.600469:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000d8c304 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944766464:12345-0@lo:101: Request processed in 163us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940497.600475:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788940497.600914:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd1947dd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944766464:0@lo:101: 00010000:00010000:1.0:1788940497.600933:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000363cf4d7/0x9c34acc08badce68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce6f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940497.600953:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000363cf4d7/0x9c34acc08badce68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badce6f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940497.601047:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0a08df1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944766592:0@lo:501: 00000100:00100000:1.0:1788940497.601085:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940497.601117:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b5a40875 going to sleep for 11 seconds 00000100:00100000:0.0:1788940497.601181:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944766592 00000100:00100000:0.0:1788940497.601187:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944766592 00000100:00100000:0.0:1788940497.601212:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788940497.601218:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0b78cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944766592:12345-0@lo:501: 00000100:00100000:0.0:1788940497.601314:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0b78cdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944766592:12345-0@lo:501: Request processed in 96us (229us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940497.601321:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788940497.601417:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0a08df1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944766592:0@lo:501: 10000000:01000000:1.0:1788940497.601449:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788940497.601456:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: 00000000363cf4d7/0x9c34acc08badce68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce6f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940497.601462:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: 00000000363cf4d7/0x9c34acc08badce68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce6f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788940497.608141:0:6526:0:(import.c:65:import_set_state_nolock()) 00000000818bd4c3 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940497.608419:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050336efa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875839944765696:12345-0@lo:38: Request processed in 14165us (14456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940497.608430:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788940497.608831:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788940497.608843:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788940497.608862:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788940497.608868:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788940497.608870:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000291ea1ee lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788940497.608927:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000264a5f3): req@0000000080ff6b08 x1875839944766208/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940497.608952:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb0f48fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944765696:0@lo:38: 00000100:00100000:3.0:1788940497.609089:0:7797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940497.609133:0:7797:0:(client.c:2716:ptlrpc_set_wait()) set 000000000264a5f3 going to sleep for 11 seconds 00000100:00100000:1.0:1788940497.609189:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944766208 00000100:00100000:1.0:1788940497.609210:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944766208 00000100:00100000:1.0:1788940497.609251:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788940497.609284:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9482c4b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7797:x1875839944766208:12345-0@lo:1000: 00000100:00100000:1.0:1788940497.609355:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9482c4b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7797:x1875839944766208:12345-0@lo:1000: Request processed in 73us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940497.609363:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788940497.609451:0:7797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000080ff6b08 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1875839944766208:0@lo:1000: 00000040:01000000:2.0:1788940497.609480:0:7797:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788940497.609513:0:7797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000080ff6b08 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1875839944766720:0@lo:1000: 00000100:00100000:2.0:1788940497.609557:0:7797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940497.609715:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944766720 00000100:00100000:1.0:1788940497.609720:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944766720 00000100:00100000:1.0:1788940497.609743:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788940497.609749:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069d2becd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7797:x1875839944766720:12345-0@lo:1000: 00000100:00100000:1.0:1788940497.609837:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069d2becd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7797:x1875839944766720:12345-0@lo:1000: Request processed in 88us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940497.609851:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788940497.610084:0:7797:0:(client.c:2716:ptlrpc_set_wait()) set 000000000264a5f3 going to sleep for 11 seconds 00000100:00100000:2.0:1788940497.610099:0:7797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000080ff6b08 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1875839944766720:0@lo:1000: 00000100:00100000:2.0:1788940497.610136:0:7797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000080ff6b08 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1875839944766848:0@lo:700: 00000100:00100000:2.0:1788940497.610161:0:7797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940497.610187:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944766848 00000100:00100000:2.0:1788940497.610190:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944766848 00000100:00100000:2.0:1788940497.610223:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940497.610229:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000096b96ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7797:x1875839944766848:12345-0@lo:700: 00000100:00100000:2.0:1788940497.610283:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000096b96ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7797:x1875839944766848:12345-0@lo:700: Request processed in 55us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940497.610290:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940497.610305:0:7797:0:(client.c:2716:ptlrpc_set_wait()) set 000000003e080e52 going to sleep for 11 seconds 00000100:00100000:2.0:1788940497.610317:0:7797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000080ff6b08 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1875839944766848:0@lo:700: 00000100:00100000:2.0:1788940497.610512:0:7797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000080ff6b08 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1875839944766976:0@lo:1000: 00000100:00100000:2.0:1788940497.610537:0:7797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940497.610849:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944766976 00000100:00100000:2.0:1788940497.610854:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944766976 00000100:00100000:2.0:1788940497.610918:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788940497.610925:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d52bc761 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7797:x1875839944766976:12345-0@lo:1000: 00000100:00100000:2.0:1788940497.610973:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d52bc761 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7797:x1875839944766976:12345-0@lo:1000: Request processed in 49us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940497.610979:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940497.611403:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940497.611480:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003230586a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944767104:0@lo:41: 00000100:00100000:0.0:1788940497.611513:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940497.611795:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944767104 00000100:00100000:0.0:1788940497.611801:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944767104 00000100:00100000:0.0:1788940497.611824:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940497.611831:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082a4905c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875839944767104:12345-0@lo:41: 00000004:00000024:0.0:1788940497.611854:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788940497.611917:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082a4905c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875839944767104:12345-0@lo:41: Request processed in 87us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940497.611924:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940497.611983:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003230586a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944767104:0@lo:41: 00000100:00100000:2.0:1788940497.612133:0:7797:0:(client.c:2716:ptlrpc_set_wait()) set 000000006fc40329 going to sleep for 11 seconds 00000100:00100000:2.0:1788940497.612151:0:7797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000080ff6b08 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1875839944766976:0@lo:1000: 00000004:00080000:2.0:1788940497.612201:0:7797:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000003e080e52 with version 0 00000020:00100000:2.0:1788940497.612218:0:7797:0:(genops.c:2436:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788940497.612224:0:7797:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000080ff6b08 x1875839944767360/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940497.612239:0:7797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000080ff6b08 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1875839944767360:0@lo:1000: 00000100:00100000:2.0:1788940497.612325:0:7797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940497.612338:0:7797:0:(client.c:2716:ptlrpc_set_wait()) set 000000006fc40329 going to sleep for 11 seconds 00000100:00100000:3.0:1788940497.612400:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944767360 00000100:00100000:3.0:1788940497.612406:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944767360 00000100:00100000:3.0:1788940497.612507:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788940497.612513:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f68f045f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7797:x1875839944767360:12345-0@lo:1000: 00000001:00080000:0.0:1788940497.626056:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1788940497.626069:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788940497.626464:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f68f045f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7797:x1875839944767360:12345-0@lo:1000: Request processed in 13948us (14136us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788940497.626491:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1788940497.626834:0:7797:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788940497.626839:0:7797:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788940497.626854:0:7797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000080ff6b08 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1875839944767360:0@lo:1000: 00000100:00100000:2.0:1788940497.626939:0:7797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000080ff6b08 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1875839944767488:0@lo:1000: 00000100:00100000:2.0:1788940497.626978:0:7797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940497.627032:0:7797:0:(client.c:2716:ptlrpc_set_wait()) set 000000005a1cc637 going to sleep for 11 seconds 00000100:00100000:0.0:1788940497.628351:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944767488 00000100:00100000:0.0:1788940497.628363:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944767488 00000100:00100000:0.0:1788940497.628444:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788940497.628454:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efa1e6b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7797:x1875839944767488:12345-0@lo:1000: 00000100:00100000:0.0:1788940497.628807:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efa1e6b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7797:x1875839944767488:12345-0@lo:1000: Request processed in 354us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940497.628815:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788940497.629096:0:7797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000080ff6b08 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7797:1875839944767488:0@lo:1000: 00000040:00080000:1.0:1788940497.629125:0:7797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788940497.629165:0:7797:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000b5a40875 with version 1 00000004:00080000:3.0:1788940497.629690:0:7795:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000004e160c54 version 1 rpc_version 1 00000020:00100000:3.0:1788940497.629721:0:7795:0:(genops.c:2436:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788940497.629742:0:7795:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000026181832 x1875839944767744/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940497.629762:0:7795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000026181832 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7795:1875839944767744:0@lo:1000: 00000100:00100000:3.0:1788940497.629814:0:7795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940497.629860:0:7795:0:(client.c:2716:ptlrpc_set_wait()) set 00000000deaff519 going to sleep for 11 seconds 00000100:00100000:2.0:1788940497.630480:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944767744 00000100:00100000:2.0:1788940497.630488:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944767744 00000100:00100000:2.0:1788940497.630546:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940497.630554:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af435138 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7795:x1875839944767744:12345-0@lo:1000: 00000040:00080000:1.0:1788940497.636153:0:7797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788940497.636227:0:7797:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788940497.636231:0:7797:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1788940497.663858:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1788940497.666124:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af435138 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7795:x1875839944767744:12345-0@lo:1000: Request processed in 35563us (36302us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788940497.666140:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1788940497.666306:0:7795:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788940497.666325:0:7795:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788940497.666342:0:7795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000026181832 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7795:1875839944767744:0@lo:1000: 00010000:00010000:0.0:1788940498.207094:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940499.227566:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940500.251472:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788940500.490629:0:7881:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788940500.490883:0:7881:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788940501.149713:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e801e57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944767872:0@lo:41: 00000100:00100000:0.0:1788940501.149794:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940501.149960:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944767872 00000100:00100000:2.0:1788940501.149968:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944767872 00000100:00100000:2.0:1788940501.150036:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940501.150045:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003230586a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944767872:12345-0@lo:41: 00000004:00000024:2.0:1788940501.150081:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788940501.150138:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003230586a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944767872:12345-0@lo:41: Request processed in 95us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940501.150146:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940501.150196:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e801e57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944767872:0@lo:41: 00010000:00010000:1.0:1788940501.280693:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788940501.662742:0:7929:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff02dbdfd0 20000000:00000080:1.0:1788940501.662761:0:7929:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91d03456b000 uarg=0000000000000000 20000000:01000000:1.0:1788940501.662805:0:7929:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788940501.662812:0:7929:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788940501.662817:0:7929:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788940501.662907:0:7929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788940501.662920:0:7929:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788940501.667504:0:7929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940501.667775:0:7929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788940501.667813:0:7929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788940501.667827:0:7929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788940501.667844:0:7929:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788940501.667862:0:7929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008fd39775/0x9c34acc08badce76 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940501.667880:0:7929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000d281b4a/0x9c34acc08badccf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badccee expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940501.667887:0:7929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000085866eb3/0x9c34acc08badcde3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcddc expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940501.667905:0:7929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008fd39775/0x9c34acc08badce76 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940501.667950:0:7929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000085866eb3/0x9c34acc08badcde3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badcddc expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940501.667965:0:7929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000085866eb3/0x9c34acc08badcde3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badcddc expref: 17 pid: 6513 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940501.667990:0:7929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0a08df1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1875839944768000:0@lo:104: 00000100:00100000:1.0:1788940501.668079:0:7929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940501.668311:0:7929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000d281b4a/0x9c34acc08badccf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badccee expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940501.668320:0:7929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000d281b4a/0x9c34acc08badccf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badccee expref: 17 pid: 6513 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940501.668328:0:7929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7832e28 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1875839944768128:0@lo:104: 00000100:00100000:1.0:1788940501.668350:0:7929:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d20a8dd1 going to sleep for 11 seconds 00000100:00100000:3.0:1788940501.670609:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788940501.670656:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940501.670723:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944768000 00000100:00100000:3.0:1788940501.670733:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944768000 00000100:00100000:2.0:1788940501.670791:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944768128 00000100:00100000:2.0:1788940501.670796:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944768128 00000100:00100000:2.0:1788940501.670820:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940501.670829:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083ad8cf4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:7929:x1875839944768000:12345-0@lo:104: 00010000:00010000:2.0:1788940501.670845:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcddc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcde3 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940501.670952:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788940501.670958:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083ad8cf4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:7929:x1875839944768000:12345-0@lo:104: Request processed in 131us (2880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940501.670965:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940501.671015:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788940501.671021:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9d01f25 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:7929:x1875839944768128:12345-0@lo:104: 00010000:00010000:2.0:1788940501.671028:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: 00000000e206da54/0x9c34acc08badccee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badccf5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940501.671125:0:7929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0a08df1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1875839944768000:0@lo:104: 00000100:00100000:1.0:1788940501.671147:0:7929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7832e28 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1875839944768128:0@lo:104: 00010000:00010000:1.0:1788940501.671167:0:7929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008fd39775/0x9c34acc08badce76 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.671391:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940501.671397:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcddc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcde3 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.671405:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000024df3b2 already unused, calling callback (000000009553f981) 10000000:00010000:0.0:1788940501.671408:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcddc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcde3 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.671416:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcddc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcde3 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940501.671432:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcddc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcde3 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940501.671438:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788940501.671506:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcddc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcde3 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.671513:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940501.671538:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcddc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcde3 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.671546:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: 00000000024df3b2/0x9c34acc08badcddc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcde3 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.671558:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940501.671560:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: 00000000e206da54/0x9c34acc08badccee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badccf5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.671565:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e206da54 already unused, calling callback (000000009553f981) 10000000:00010000:0.0:1788940501.671567:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: 00000000e206da54/0x9c34acc08badccee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badccf5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.671573:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: 00000000e206da54/0x9c34acc08badccee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badccf5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940501.671577:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: 00000000e206da54/0x9c34acc08badccee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badccf5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940501.671582:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788940501.671627:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788940501.671633:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9d01f25 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:7929:x1875839944768128:12345-0@lo:104: Request processed in 613us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940501.671640:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788940501.671659:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940501.671715:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000953f4e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944768256:0@lo:103: 00000100:00100000:3.0:1788940501.671752:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940501.671866:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944768256 00000100:00100000:2.0:1788940501.671871:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944768256 00010000:00010000:2.0:1788940501.671890:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000085866eb3/0x9c34acc08badcde3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcddc expref: 18 pid: 6513 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940501.671919:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940501.671926:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1864b8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:3647:x1875839944768256:12345-0@lo:103: 00010000:00010000:2.0:1788940501.671936:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940501.671940:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: 0000000085866eb3/0x9c34acc08badcde3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcddc expref: 18 pid: 6513 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940501.671951:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000085866eb3/0x9c34acc08badcde3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badcddc expref: 18 pid: 6513 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940501.671964:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000085866eb3/0x9c34acc08badcde3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badcddc expref: 18 pid: 6513 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940501.671988:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940501.672025:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1864b8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:3647:x1875839944768256:12345-0@lo:103: Request processed in 100us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940501.672031:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940501.672123:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000953f4e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944768256:0@lo:103: 00010000:00010000:0.0:1788940501.672287:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: 00000000e206da54/0x9c34acc08badccee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badccf5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.672295:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940501.672312:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: 00000000e206da54/0x9c34acc08badccee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badccf5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.672317:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: 00000000e206da54/0x9c34acc08badccee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badccf5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.672331:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940501.672332:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940501.672334:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940501.672377:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036e95bc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944768384:0@lo:103: 00000100:00100000:3.0:1788940501.672404:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940501.672496:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944768384 00000100:00100000:0.0:1788940501.672501:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944768384 00010000:00010000:0.0:1788940501.672518:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000d281b4a/0x9c34acc08badccf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badccee expref: 17 pid: 6513 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940501.672547:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788940501.672553:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ca68bf3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:3648:x1875839944768384:12345-0@lo:103: 00010000:00010000:0.0:1788940501.672561:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940501.672564:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: 000000000d281b4a/0x9c34acc08badccf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badccee expref: 17 pid: 6513 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.672572:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000d281b4a/0x9c34acc08badccf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badccee expref: 17 pid: 6513 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.672581:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000d281b4a/0x9c34acc08badccf5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badccee expref: 17 pid: 6513 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.672593:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008fd39775/0x9c34acc08badce76 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.672612:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008fd39775/0x9c34acc08badce76 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.672627:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008fd39775/0x9c34acc08badce76 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.672633:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008fd39775/0x9c34acc08badce76 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.672640:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008fd39775/0x9c34acc08badce76 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.672646:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008fd39775/0x9c34acc08badce76 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.672651:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008fd39775 already unused, calling callback (000000007b9d4142) 00010000:00010000:0.0:1788940501.672654:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008fd39775/0x9c34acc08badce76 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.672661:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008fd39775/0x9c34acc08badce76 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.672674:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008fd39775/0x9c34acc08badce76 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940501.672683:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940501.672711:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ca68bf3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:3648:x1875839944768384:12345-0@lo:103: Request processed in 159us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940501.672718:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940501.672781:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036e95bc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944768384:0@lo:103: 00010000:00010000:1.0:1788940501.672908:0:7929:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008fd39775/0x9c34acc08badce76 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940501.672927:0:7929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008fd39775/0x9c34acc08badce76 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940501.672932:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008fd39775/0x9c34acc08badce76 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940502.302885:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940502.684484:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbd97f86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944768512:0@lo:41: 00000100:00100000:2.0:1788940502.689103:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e801e57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944768768:0@lo:400: 00000100:00100000:0.0:1788940502.690463:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940502.690653:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940502.690775:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940502.690790:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a6d91e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944768896:0@lo:400: 00000100:00100000:2.0:1788940502.690897:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944768768 00000100:00100000:2.0:1788940502.690910:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944768768 00000100:00100000:2.0:1788940502.691000:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788940502.691010:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a52f424 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944768768:12345-0@lo:400: 00000100:00100000:2.0:1788940502.691083:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a52f424 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944768768:12345-0@lo:400: Request processed in 75us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940502.691092:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940502.691945:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c01dddcf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944768640:0@lo:400: 00000100:00100000:1.0:1788940502.692020:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940502.692072:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a46dd31a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944769152:0@lo:400: 00000100:00100000:0.0:1788940502.692490:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000785f2d3f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944769024:0@lo:400: 00000100:00100000:1.0:1788940502.692557:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944768512 00000100:00100000:1.0:1788940502.692566:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944768512 00000100:00100000:1.0:1788940502.692609:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788940502.692615:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036e95bc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944768512:12345-0@lo:41: 00000004:00000024:1.0:1788940502.692666:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788940502.692754:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940502.692922:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944769024 00000100:00100000:0.0:1788940502.692932:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944769024 00000100:00100000:0.0:1788940502.693015:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788940502.693026:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000953f4e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944769024:12345-0@lo:400: 00000100:00100000:0.0:1788940502.693101:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000953f4e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944769024:12345-0@lo:400: Request processed in 76us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940502.693109:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940502.693112:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944768640 00000100:00100000:2.0:1788940502.693123:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944768640 00000100:00100000:0.0:1788940502.693143:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940502.693186:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788940502.693197:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099f9aa1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:3646:x1875839944768640:12345-0@lo:400: 00000100:00100000:0.0:1788940502.697488:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944769152 00000100:00100000:0.0:1788940502.697508:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944769152 00000100:00100000:0.0:1788940502.697559:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788940502.697881:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd1285e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875839944769152:12345-0@lo:400: 00000100:00100000:2.0:1788940502.700922:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099f9aa1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:3646:x1875839944768640:12345-0@lo:400: Request processed in 7708us (8883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940502.700946:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788940502.701403:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036e95bc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875839944768512:12345-0@lo:41: Request processed in 8776us (10939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940502.701420:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940502.701819:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c01dddcf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944768640:0@lo:400: 00000100:00100000:2.0:1788940502.701925:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788940502.702004:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007e801e57 x1875839944768768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940502.702018:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e801e57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944768768:0@lo:400: 00000100:00100000:1.0:1788940502.704969:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944768896 00000100:00100000:1.0:1788940502.704989:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944768896 00000100:00100000:3.0:1788940502.705009:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a46dd31a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944769152:0@lo:400: 00000100:00100000:1.0:1788940502.705059:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788940502.705071:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c01dddcf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944768896:12345-0@lo:400: 00000100:00100000:0.0:1788940502.705809:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd1285e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944769152:12345-0@lo:400: Request processed in 7634us (12367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940502.705823:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788940502.705972:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000785f2d3f x1875839944769024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940502.705985:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000785f2d3f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944769024:0@lo:400: 00000100:00100000:0.0:1788940502.706007:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbd97f86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944768512:0@lo:41: 00000100:00100000:1.0:1788940502.706640:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c01dddcf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944768896:12345-0@lo:400: Request processed in 1569us (4712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940502.706650:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788940502.707484:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a6d91e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944768896:0@lo:400: 00010000:00010000:0.0:1788940503.325885:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940504.361713:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940505.377839:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940506.271846:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940506.271883:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a6d91e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944769280:0@lo:41: 00000100:00100000:2.0:1788940506.272018:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940506.272119:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944769280 00000100:00100000:2.0:1788940506.272130:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944769280 00000100:00100000:2.0:1788940506.272204:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788940506.272214:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e801e57 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944769280:12345-0@lo:41: 00000004:00000024:2.0:1788940506.272287:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788940506.272343:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e801e57 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944769280:12345-0@lo:41: Request processed in 131us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940506.272351:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788940506.272410:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a6d91e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944769280:0@lo:41: 00010000:00010000:2.0:1788940506.395594:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788940507.292160:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788940507.292173:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d034739000 from 1 10000000:01000000:1.0:1788940507.292180:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940507.292253:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: 00000000b1aae4c2/0x9c34acc08badce7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940507.292292:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: 00000000b1aae4c2/0x9c34acc08badce7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940507.292307:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: 00000000b1aae4c2/0x9c34acc08badce7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940507.292339:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7832e28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944769408:0@lo:101: 00000100:00100000:1.0:1788940507.292441:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940507.292508:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037342811 going to sleep for 11 seconds 00000100:00100000:2.0:1788940507.292772:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944769408 00000100:00100000:2.0:1788940507.292785:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944769408 00000100:00100000:2.0:1788940507.292866:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788940507.292877:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016292948 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944769408:12345-0@lo:101: 00010000:00010000:2.0:1788940507.292896:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940507.292913:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aa93aac0/0x9c34acc08badce84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badce7d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940507.292958:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aa93aac0/0x9c34acc08badce84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badce7d expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940507.292971:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aa93aac0/0x9c34acc08badce84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badce7d expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940507.292982:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aa93aac0, rc 0) 00000100:00100000:2.0:1788940507.293038:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016292948 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944769408:12345-0@lo:101: Request processed in 161us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940507.293059:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788940507.293332:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7832e28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944769408:0@lo:101: 00010000:00010000:1.0:1788940507.293351:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: 00000000b1aae4c2/0x9c34acc08badce7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940507.293361:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: 00000000b1aae4c2/0x9c34acc08badce7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badce84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940507.293443:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7832e28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944769536:0@lo:501: 00000100:00100000:1.0:1788940507.293485:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940507.293517:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037342811 going to sleep for 11 seconds 00000100:00100000:2.0:1788940507.293755:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944769536 00000100:00100000:2.0:1788940507.293763:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944769536 00000100:00100000:2.0:1788940507.293802:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788940507.293809:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071547716 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944769536:12345-0@lo:501: 00000100:00100000:2.0:1788940507.295373:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071547716 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944769536:12345-0@lo:501: Request processed in 1559us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940507.295388:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788940507.295460:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7832e28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944769536:0@lo:501: 00000100:00100000:2.0:1788940507.299525:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a6d91e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944769664:0@lo:503: 00000100:00100000:2.0:1788940507.299657:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940507.299725:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3575633 going to sleep for 11 seconds 00000100:00100000:1.0:1788940507.299757:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944769664 00000100:00100000:1.0:1788940507.299769:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944769664 00000100:00100000:1.0:1788940507.299873:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788940507.299883:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d1e292 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944769664:12345-0@lo:503: 00000100:00100000:1.0:1788940507.300045:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d1e292 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944769664:12345-0@lo:503: Request processed in 163us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940507.300054:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788940507.301750:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a6d91e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944769664:0@lo:503: 00000100:00100000:2.0:1788940507.308822:0:8134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a6d91e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8134:1875839944769792:0@lo:502: 00000100:00100000:2.0:1788940507.309029:0:8134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940507.309138:0:8134:0:(client.c:2716:ptlrpc_set_wait()) set 0000000039a21213 going to sleep for 11 seconds 00000100:00100000:1.0:1788940507.319065:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944769792 00000100:00100000:1.0:1788940507.319089:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944769792 00000100:00100000:1.0:1788940507.319224:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788940507.319235:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f859579 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:8134:x1875839944769792:12345-0@lo:502: 00000100:00100000:1.0:1788940507.319514:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f859579 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:8134:x1875839944769792:12345-0@lo:502: Request processed in 280us (10485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940507.319524:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788940507.324907:0:8134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a6d91e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8134:1875839944769792:0@lo:502: 00000020:01000000:2.0:1788940507.324988:0:8134:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940507.325008:0:8134:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940507.325011:0:8134:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788940507.325018:0:8134:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d034739000 00000020:00000080:2.0:1788940507.325022:0:8134:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788940507.325106:0:8134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8134:1875839944769920:0@lo:502: 00000100:00100000:2.0:1788940507.325222:0:8134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940507.325294:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944769920 00000100:00100000:2.0:1788940507.325311:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944769920 00000100:00100000:2.0:1788940507.325373:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788940507.325383:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:8134:x1875839944769920:12345-0@lo:502: 00000100:00100000:2.0:1788940507.325552:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:8134:x1875839944769920:12345-0@lo:502: Request processed in 170us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940507.325563:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788940507.325629:0:8134:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0358d8600 going to sleep for 11 seconds 00000100:00100000:2.0:1788940507.325656:0:8134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8134:1875839944769920:0@lo:502: 00000020:01000000:2.0:1788940507.325676:0:8134:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940507.325681:0:8134:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940507.325682:0:8134:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788940507.325686:0:8134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788940507.326579:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788940507.326619:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940507.326646:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa800/0x9c34acc08badce7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940507.326661:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa800/0x9c34acc08badce7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940507.326675:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788940507.326679:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d004f4a000 from 1 10000000:01000000:1.0:1788940507.326683:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940507.326724:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa200/0x9c34acc08badce8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940507.326733:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa200/0x9c34acc08badce8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940507.326744:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa200/0x9c34acc08badce8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940507.326765:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944770048:0@lo:101: 00000100:00100000:1.0:1788940507.326825:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940507.326871:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050f5180 going to sleep for 11 seconds 00000100:00100000:2.0:1788940507.327763:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944770048 00000100:00100000:2.0:1788940507.327777:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944770048 00000100:00100000:2.0:1788940507.328113:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788940507.328130:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944770048:12345-0@lo:101: 00010000:00010000:2.0:1788940507.328151:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940507.328175:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d042052000/0x9c34acc08badce92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badce8b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940507.328215:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d042052000/0x9c34acc08badce92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badce8b expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940507.328229:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d042052000/0x9c34acc08badce92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badce8b expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940507.328242:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d042052000, rc 0) 00000100:00100000:2.0:1788940507.328346:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944770048:12345-0@lo:101: Request processed in 221us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940507.328363:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788940507.329015:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944770048:0@lo:101: 00010000:00010000:1.0:1788940507.329040:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa200/0x9c34acc08badce8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce92 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940507.329052:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa200/0x9c34acc08badce8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badce92 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940507.329159:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944770176:0@lo:501: 00000100:00100000:1.0:1788940507.329209:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940507.329291:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050f5180 going to sleep for 11 seconds 00000100:00100000:2.0:1788940507.329439:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944770176 00000100:00100000:2.0:1788940507.329446:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944770176 00000100:00100000:2.0:1788940507.329497:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788940507.329507:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944770176:12345-0@lo:501: 00000100:00100000:2.0:1788940507.329769:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944770176:12345-0@lo:501: Request processed in 264us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940507.329778:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788940507.329878:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944770176:0@lo:501: 00000100:00100000:1.0:1788940507.329925:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944770304:0@lo:503: 00000100:00100000:1.0:1788940507.329968:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940507.329999:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050f5180 going to sleep for 11 seconds 00000100:00100000:2.0:1788940507.330108:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944770304 00000100:00100000:2.0:1788940507.330113:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944770304 00000100:00100000:2.0:1788940507.330145:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788940507.330153:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944770304:12345-0@lo:503: 00000100:00100000:2.0:1788940507.330239:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944770304:12345-0@lo:503: Request processed in 86us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940507.330245:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788940507.330522:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944770304:0@lo:503: 00000100:00100000:1.0:1788940507.331414:0:8136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8136:1875839944770432:0@lo:502: 00000100:00100000:1.0:1788940507.331550:0:8136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940507.331591:0:8136:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050f5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940507.331780:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944770432 00000100:00100000:2.0:1788940507.331789:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944770432 00000100:00100000:2.0:1788940507.331831:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788940507.331840:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:8136:x1875839944770432:12345-0@lo:502: 00000100:00100000:2.0:1788940507.332065:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:8136:x1875839944770432:12345-0@lo:502: Request processed in 225us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940507.332073:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788940507.332184:0:8136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8136:1875839944770432:0@lo:502: 00000020:01000000:1.0:1788940507.332217:0:8136:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940507.332231:0:8136:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940507.332234:0:8136:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788940507.332243:0:8136:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d004f4a000 00000020:00000080:1.0:1788940507.332247:0:8136:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788940507.332302:0:8136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8136:1875839944770560:0@lo:502: 00000100:00100000:1.0:1788940507.332733:0:8136:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940507.332779:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944770560 00000100:00100000:1.0:1788940507.332784:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944770560 00000100:00100000:1.0:1788940507.332814:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788940507.332821:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:8136:x1875839944770560:12345-0@lo:502: 00000100:00100000:1.0:1788940507.334044:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:8136:x1875839944770560:12345-0@lo:502: Request processed in 1216us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940507.334056:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788940507.334134:0:8136:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050f5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940507.334160:0:8136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8136:1875839944770560:0@lo:502: 00000020:01000000:1.0:1788940507.334198:0:8136:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940507.334208:0:8136:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940507.334210:0:8136:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788940507.334217:0:8136:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788940507.334555:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788940507.334589:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940507.334603:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa200/0x9c34acc08badce8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce92 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940507.334633:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa200/0x9c34acc08badce8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badce92 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940507.425226:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940507.804534:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944770688:0@lo:41: 00000100:00100000:1.0:1788940507.804682:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940507.810418:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944770944:0@lo:400: 00000100:00100000:3.0:1788940507.810620:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940507.810781:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944770816:0@lo:400: 00000100:00100000:1.0:1788940507.810829:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940507.810940:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944770688 00000100:00100000:0.0:1788940507.810952:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944770688 00000100:00100000:1.0:1788940507.810983:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944770816 00000100:00100000:1.0:1788940507.810988:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944770816 00000100:00100000:1.0:1788940507.811104:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788940507.811116:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:3645:x1875839944770816:12345-0@lo:400: 00000100:00100000:1.0:1788940507.811181:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:3645:x1875839944770816:12345-0@lo:400: Request processed in 66us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940507.811188:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788940507.811229:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944771072:0@lo:400: 00000100:00100000:1.0:1788940507.811283:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940507.816767:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944771072 00000100:00100000:1.0:1788940507.816835:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940507.816963:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944771200:0@lo:400: 00000100:00100000:1.0:1788940507.817069:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940507.817135:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944770944 00000100:00100000:1.0:1788940507.817145:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944770944 00000100:00100000:2.0:1788940507.817340:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788940507.817359:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944770688:12345-0@lo:41: 00000004:00000024:2.0:1788940507.817421:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788940507.817504:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944770688:12345-0@lo:41: Request processed in 151us (12825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940507.817512:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788940507.817664:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944771072 00000100:00100000:0.0:1788940507.817711:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788940507.817718:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944771072:12345-0@lo:400: 00000100:00100000:0.0:1788940507.817767:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944771072:12345-0@lo:400: Request processed in 50us (6483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940507.817774:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788940507.818637:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944770688:0@lo:41: 00000100:00100000:1.0:1788940507.819836:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944771200 00000100:00100000:0.0:1788940507.821113:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944770816:0@lo:400: 00000100:00100000:1.0:1788940507.821225:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944771200 00000100:00100000:2.0:1788940507.821374:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788940507.821395:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944770944:12345-0@lo:400: 00000100:00100000:2.0:1788940507.821541:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944770944:12345-0@lo:400: Request processed in 156us (10921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940507.821549:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788940507.821574:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788940507.821579:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944771200:12345-0@lo:400: 00000100:00100000:2.0:1788940507.821612:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944771200:12345-0@lo:400: Request processed in 33us (4547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940507.821618:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788940507.821824:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d020c8c700 x1875839944770944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940507.821851:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944770944:0@lo:400: 00010000:00080000:0.0:1788940507.824094:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d020c8dc00 x1875839944771200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940507.824120:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944771200:0@lo:400: 00000100:00100000:0.0:1788940507.824139:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944771072:0@lo:400: 00010000:00010000:2.0:1788940508.443449:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940509.469772:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940510.499933:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940511.390299:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940511.390338:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944771328:0@lo:41: 00000100:00100000:2.0:1788940511.390462:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940511.390549:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944771328 00000100:00100000:2.0:1788940511.390560:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944771328 00000100:00100000:2.0:1788940511.390618:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788940511.390629:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944771328:12345-0@lo:41: 00000004:00000024:2.0:1788940511.390673:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788940511.390725:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944771328:12345-0@lo:41: Request processed in 97us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940511.390732:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788940511.390787:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944771328:0@lo:41: 00010000:00010000:2.0:1788940511.515638:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940512.540860:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940512.923663:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944771456:0@lo:41: 00000100:00100000:2.0:1788940512.923774:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940512.923980:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944771456 00000100:00100000:0.0:1788940512.923994:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944771456 00000100:00100000:0.0:1788940512.924069:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788940512.924082:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944771456:12345-0@lo:41: 00000004:00000024:0.0:1788940512.924140:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788940512.924210:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944771456:12345-0@lo:41: Request processed in 131us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940512.924218:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788940512.924309:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944771456:0@lo:41: 00000100:00100000:3.0:1788940512.935020:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944771840:0@lo:400: 00000100:00100000:3.0:1788940512.935136:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940512.935288:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944771584:0@lo:400: 00000100:00100000:0.0:1788940512.935341:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940512.935377:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940512.935384:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944771712:0@lo:400: 00000100:00100000:0.0:1788940512.935414:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940512.935527:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944771584 00000100:00100000:1.0:1788940512.935540:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944771584 00000100:00100000:1.0:1788940512.935622:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788940512.935634:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:3647:x1875839944771584:12345-0@lo:400: 00000100:00100000:1.0:1788940512.935701:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:3647:x1875839944771584:12345-0@lo:400: Request processed in 70us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940512.935709:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788940512.935772:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944771584:0@lo:400: 00000100:00100000:3.0:1788940512.936925:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940512.936946:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944771968:0@lo:400: 00000100:00100000:3.0:1788940512.937022:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940512.937139:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944771712 00000100:00100000:0.0:1788940512.937149:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944771712 00000100:00100000:0.0:1788940512.937198:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944771968 00000100:00100000:0.0:1788940512.937202:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944771968 00000100:00100000:0.0:1788940512.937219:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940512.937227:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944771712:12345-0@lo:400: 00000100:00100000:0.0:1788940512.937329:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944771712:12345-0@lo:400: Request processed in 102us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940512.937337:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940512.937355:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940512.937361:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944771968:12345-0@lo:400: 00000100:00100000:0.0:1788940512.937398:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944771968:12345-0@lo:400: Request processed in 38us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940512.937404:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788940512.937459:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d0042b2a00 x1875839944771968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940512.937473:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944771968:0@lo:400: 00010000:00080000:3.0:1788940512.937689:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d0042b3480 x1875839944771712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940512.937701:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944771712:0@lo:400: 00000100:00100000:2.0:1788940512.937819:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944771840 00000100:00100000:2.0:1788940512.937826:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944771840 00000100:00100000:2.0:1788940512.937881:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940512.937889:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944771840:12345-0@lo:400: 00000100:00100000:2.0:1788940512.937941:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944771840:12345-0@lo:400: Request processed in 53us (2805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940512.937947:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788940512.938078:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944771840:0@lo:400: 00010000:00010000:1.0:1788940513.564829:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940514.589095:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788940514.899914:0:8430:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788940514.899920:0:8430:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788940514.899922:0:8430:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788940514.900084:0:8430:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91d035758800 00000020:01000004:2.0:1788940514.900108:0:8430:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788940514.900125:0:8430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788940514.900155:0:8430:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osd (ffff91d035a8b3b0) 00000020:00000080:2.0:1788940514.900178:0:8430:0:(obd_config.c:786:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788940514.974517:0:8430:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788940514.974588:0:8430:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1788940515.001592:0:8430:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788940515.001921:0:8430:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788940515.001938:0:8430:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788940515.001955:0:8430:0:(genops.c:1393:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9c34acc08badcea0 00000020:01000004:2.0:1788940515.001965:0:8430:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788940515.001993:0:8430:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788940515.001998:0:8430:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788940515.002006:0:8430:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788940515.002012:0:8430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788940515.002028:0:8430:0:(genops.c:415:class_newdev()) Allocate new device OSS (ffff91d035a899d8) 00000020:00000080:2.0:1788940515.002044:0:8430:0:(obd_config.c:786:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788940515.011644:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940515.011872:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788940515.011880:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788940515.017250:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788940515.018650:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788940515.019653:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788940515.019664:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788940515.029686:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940515.029971:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788940515.029979:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788940515.034964:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788940515.034980:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788940515.096484:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940515.096778:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788940515.096787:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788940515.099111:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788940515.099133:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788940515.101743:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788940515.101762:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788940515.109936:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940515.110476:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788940515.110486:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788940515.111571:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788940515.111581:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788940515.178702:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940515.179022:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788940515.179030:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788940515.182381:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788940515.182401:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788940515.185002:0:8430:0:(obd_config.c:900:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788940515.185051:0:8430:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788940515.185058:0:8430:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788940515.212968:0:8430:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788940515.213017:0:8430:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.125@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788940515.213022:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788940515.213024:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788940515.213025:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940515.213026:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940515.213028:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940515.213029:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940515.213031:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940515.213033:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940515.213034:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940515.213036:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940515.213037:0:8430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940515.213040:0:8430:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788940515.213043:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940515.213049:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788940515.213051:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940515.213052:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940515.213053:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940515.213054:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940515.213055:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940515.213056:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940515.213057:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940515.213057:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940515.213058:0:8430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940515.213088:0:8430:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788940515.213108:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944772096:0@lo:253: 00000100:00100000:2.0:1788940515.213183:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940515.213310:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02004fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940515.213425:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944772096 00000100:00100000:3.0:1788940515.213435:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944772096 00000100:00100000:3.0:1788940515.213608:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788940515.213619:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:8430:x1875839944772096:12345-0@lo:253: 20000000:01000000:3.0:1788940515.213661:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788940515.213665:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788940515.213670:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788940515.213673:0:6513:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788940515.213977:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940515.214106:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788940515.214122:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788940515.214140:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788940515.214147:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788940515.214181:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788940515.214199:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788940515.214669:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788940515.214689:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.125@tcp 20000000:01000000:2.0:1788940515.214691:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:2.0:1788940515.214705:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788940515.214711:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788940515.214725:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788940515.214731:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:2.0:1788940515.214745:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788940515.214752:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788940515.214764:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788940515.214863:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788940515.214944:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1788940515.214956:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.125@tcp 20000000:01000000:2.0:1788940515.214957:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:2.0:1788940515.214972:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1788940515.214978:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788940515.214990:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1788940515.214995:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:2.0:1788940515.215008:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1788940515.215024:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788940515.215041:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1788940515.215055:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1788940515.215479:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1788940515.215570:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.125@tcp 20000000:01000000:2.0:1788940515.215572:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:2.0:1788940515.215604:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1788940515.215611:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788940515.215625:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1788940515.215631:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:2.0:1788940515.215644:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1788940515.215651:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788940515.215663:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1788940515.215678:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1788940515.215693:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788940515.215697:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788940515.215701:0:6513:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788940515.215743:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788940515.215745:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788940515.216388:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788940515.216658:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788940515.216680:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788940515.216695:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788940515.216703:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788940515.216705:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788940515.217052:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1788940515.217072:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1788940515.217087:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788940515.217227:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1788940515.217246:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1788940515.217432:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1788940515.217445:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788940515.219122:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788940515.219791:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1788940515.219838:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1788940515.219868:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1788940515.220116:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1788940515.220143:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1788940515.220158:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1788940515.220172:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788940515.220173:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788940515.220807:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1788940515.220840:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1788940515.220870:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788940515.221070:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788940515.221093:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788940515.221110:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1788940515.221126:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788940515.221146:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d0421c0800/0x9c34acc08badceae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.221165:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d042052a00/0x9c34acc08badcd7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcd73 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.221174:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d000031c00/0x9c34acc08badcdf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcdea expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.221181:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d000031600/0x9c34acc08badce29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badce22 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.221188:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d000031e00/0x9c34acc08badce45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badce3e expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.221196:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584c800/0x9c34acc08badce6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badce68 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.221203:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d0421c0800/0x9c34acc08badceae lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.221244:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584c800/0x9c34acc08badce6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badce68 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.221309:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584c800/0x9c34acc08badce6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badce68 expref: 18 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940515.221325:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875839944772224:0@lo:104: 00000100:00100000:3.0:1788940515.221394:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940515.221459:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d000031e00/0x9c34acc08badce45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badce3e expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.221468:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d000031e00/0x9c34acc08badce45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badce3e expref: 18 pid: 6512 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940515.221476:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875839944772352:0@lo:104: 00000100:00100000:3.0:1788940515.221500:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940515.221536:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d000031600/0x9c34acc08badce29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badce22 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.221545:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d000031600/0x9c34acc08badce29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badce22 expref: 18 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940515.221553:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875839944772480:0@lo:104: 00000100:00100000:3.0:1788940515.221600:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940515.221621:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d000031c00/0x9c34acc08badcdf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badcdea expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.221629:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d000031c00/0x9c34acc08badcdf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badcdea expref: 18 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940515.221637:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06102300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875839944772608:0@lo:104: 00000100:00100000:3.0:1788940515.221666:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940515.221683:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d042052a00/0x9c34acc08badcd7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badcd73 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.221692:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d042052a00/0x9c34acc08badcd7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badcd73 expref: 18 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940515.221700:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875839944772736:0@lo:104: 00000100:00100000:3.0:1788940515.221721:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940515.221731:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d035a3ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940515.221924:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944772224 00000100:00100000:1.0:1788940515.221932:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944772224 00000100:00100000:1.0:1788940515.221968:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944772352 00000100:00100000:1.0:1788940515.221971:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944772352 00000100:00100000:1.0:1788940515.221997:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944772480 00000100:00100000:1.0:1788940515.222000:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944772480 00000100:00100000:1.0:1788940515.222009:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944772608 00000100:00100000:1.0:1788940515.222011:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944772608 00000100:00100000:1.0:1788940515.222020:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944772736 00000100:00100000:1.0:1788940515.222022:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944772736 00000100:00100000:1.0:1788940515.222034:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940515.222044:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+7:6513:x1875839944772224:12345-0@lo:104: 00010000:00010000:1.0:1788940515.222063:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d000030e00/0x9c34acc08badce68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badce6f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.222136:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788940515.222143:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+7:6513:x1875839944772224:12345-0@lo:104: Request processed in 101us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940515.222150:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940515.222169:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940515.222176:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+6:6513:x1875839944772352:12345-0@lo:104: 00010000:00010000:1.0:1788940515.222184:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d0027f7600/0x9c34acc08badce3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badce45 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.222216:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788940515.222221:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+6:6513:x1875839944772352:12345-0@lo:104: Request processed in 47us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940515.222227:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940515.222239:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788940515.222245:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06102680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+5:6513:x1875839944772480:12345-0@lo:104: 00010000:00010000:1.0:1788940515.222252:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d0421c0200/0x9c34acc08badce22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badce29 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.222311:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788940515.222316:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06102680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+5:6513:x1875839944772480:12345-0@lo:104: Request processed in 72us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940515.222322:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788940515.222334:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788940515.222340:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:6513:x1875839944772608:12345-0@lo:104: 00010000:00010000:1.0:1788940515.222354:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d0027f6a00/0x9c34acc08badcdea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcdf1 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.222383:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788940515.222388:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:6513:x1875839944772608:12345-0@lo:104: Request processed in 49us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940515.222394:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788940515.222481:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788940515.222489:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:6513:x1875839944772736:12345-0@lo:104: 00010000:00010000:1.0:1788940515.222497:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d0027f6400/0x9c34acc08badcd73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcd7a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.222525:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788940515.222530:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:6513:x1875839944772736:12345-0@lo:104: Request processed in 43us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940515.222536:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788940515.222617:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788940515.222624:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d000030e00/0x9c34acc08badce68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badce6f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.222632:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000030e00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788940515.222637:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d000030e00/0x9c34acc08badce68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badce6f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.222646:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d000030e00/0x9c34acc08badce68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badce6f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940515.222655:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d000030e00/0x9c34acc08badce68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badce6f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940515.222662:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788940515.222703:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d000030e00/0x9c34acc08badce68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce6f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.222711:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940515.222730:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d000030e00/0x9c34acc08badce68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce6f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.222750:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d000030e00/0x9c34acc08badce68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce6f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.222766:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788940515.222769:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0027f7600/0x9c34acc08badce3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badce45 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.222788:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f7600 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788940515.222791:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0027f7600/0x9c34acc08badce3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badce45 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.222799:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0027f7600/0x9c34acc08badce3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badce45 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940515.222804:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0027f7600/0x9c34acc08badce3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badce45 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940515.222809:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788940515.222825:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0027f7600/0x9c34acc08badce3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce45 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.222831:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940515.222837:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0027f7600/0x9c34acc08badce3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce45 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.222854:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0027f7600/0x9c34acc08badce3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce45 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.222865:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788940515.222875:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0421c0200/0x9c34acc08badce22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badce29 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.222881:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c0200 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788940515.222883:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c0200/0x9c34acc08badce22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badce29 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.222890:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0421c0200/0x9c34acc08badce22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badce29 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940515.222897:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c0200/0x9c34acc08badce22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badce29 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940515.222902:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788940515.222926:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0421c0200/0x9c34acc08badce22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce29 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.222932:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940515.222948:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0421c0200/0x9c34acc08badce22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce29 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.222954:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0421c0200/0x9c34acc08badce22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce29 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.222964:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940515.222966:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0027f6a00/0x9c34acc08badcdea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcdf1 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.222973:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6a00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788940515.222976:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0027f6a00/0x9c34acc08badcdea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcdf1 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.222994:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0027f6a00/0x9c34acc08badcdea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcdf1 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940515.223002:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0027f6a00/0x9c34acc08badcdea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcdf1 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940515.223008:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788940515.223021:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0027f6a00/0x9c34acc08badcdea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcdf1 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223026:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940515.223030:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0027f6a00/0x9c34acc08badcdea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcdf1 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223036:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0027f6a00/0x9c34acc08badcdea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcdf1 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223045:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940515.223048:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0027f6400/0x9c34acc08badcd73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcd7a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223054:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6400 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788940515.223057:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0027f6400/0x9c34acc08badcd73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcd7a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223063:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0027f6400/0x9c34acc08badcd73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcd7a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940515.223069:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0027f6400/0x9c34acc08badcd73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcd7a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940515.223080:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788940515.223094:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0027f6400/0x9c34acc08badcd73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcd7a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223100:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940515.223104:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0027f6400/0x9c34acc08badcd73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcd7a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223110:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0027f6400/0x9c34acc08badcd73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcd7a expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223123:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940515.223125:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940515.223126:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940515.223140:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944772864:0@lo:103: 00000100:00100000:0.0:1788940515.223176:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940515.223198:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944773376:0@lo:103: 00000100:00100000:0.0:1788940515.223216:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940515.223235:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940515.223240:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944772992:0@lo:103: 00000100:00100000:0.0:1788940515.223278:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940515.223306:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944773120:0@lo:103: 00000100:00100000:0.0:1788940515.223328:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940515.223345:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940515.223350:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944773248:0@lo:103: 00000100:00100000:0.0:1788940515.223371:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940515.223394:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944772864 00000100:00100000:0.0:1788940515.223405:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944772864 00010000:00010000:0.0:1788940515.223444:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584c800/0x9c34acc08badce6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badce68 expref: 19 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940515.223461:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944773376 00000100:00100000:0.0:1788940515.223464:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944773376 00010000:00010000:0.0:1788940515.223475:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d042052a00/0x9c34acc08badcd7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcd73 expref: 20 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940515.223484:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944772992 00000100:00100000:0.0:1788940515.223487:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944772992 00010000:00010000:0.0:1788940515.223508:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d000031e00/0x9c34acc08badce45 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badce3e expref: 21 pid: 6512 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940515.223520:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944773120 00000100:00100000:0.0:1788940515.223523:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944773120 00010000:00010000:0.0:1788940515.223532:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d000031600/0x9c34acc08badce29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badce22 expref: 22 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940515.223541:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944773248 00000100:00100000:0.0:1788940515.223543:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944773248 00010000:00010000:0.0:1788940515.223552:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d000031c00/0x9c34acc08badcdf1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcdea expref: 23 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940515.223563:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788940515.223568:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:3647:x1875839944772864:12345-0@lo:103: 00010000:00010000:0.0:1788940515.223578:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940515.223582:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584c800/0x9c34acc08badce6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badce68 expref: 23 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223592:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584c800/0x9c34acc08badce6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badce68 expref: 23 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223617:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940515.223648:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:3647:x1875839944772864:12345-0@lo:103: Request processed in 79us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940515.223655:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788940515.223680:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788940515.223686:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:3647:x1875839944773376:12345-0@lo:103: 00010000:00010000:0.0:1788940515.223694:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940515.223699:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d042052a00/0x9c34acc08badcd7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcd73 expref: 22 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223707:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d042052a00/0x9c34acc08badcd7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badcd73 expref: 22 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223716:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940515.223738:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:3647:x1875839944773376:12345-0@lo:103: Request processed in 53us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940515.223745:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788940515.223758:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940515.223764:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:3647:x1875839944772992:12345-0@lo:103: 00010000:00010000:0.0:1788940515.223772:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940515.223776:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d000031e00/0x9c34acc08badce45 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badce3e expref: 21 pid: 6512 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223785:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d000031e00/0x9c34acc08badce45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badce3e expref: 21 pid: 6512 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223794:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940515.223825:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:3647:x1875839944772992:12345-0@lo:103: Request processed in 61us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940515.223831:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940515.223855:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940515.223861:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:3645:x1875839944773120:12345-0@lo:103: 00010000:00010000:0.0:1788940515.223869:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940515.223874:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d000031600/0x9c34acc08badce29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badce22 expref: 20 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223883:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d000031600/0x9c34acc08badce29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badce22 expref: 20 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223892:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940515.223916:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:3645:x1875839944773120:12345-0@lo:103: Request processed in 55us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940515.223921:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940515.223934:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940515.223940:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:3645:x1875839944773248:12345-0@lo:103: 00010000:00010000:0.0:1788940515.223946:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940515.223950:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d000031c00/0x9c34acc08badcdf1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcdea expref: 19 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223958:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d000031c00/0x9c34acc08badcdf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badcdea expref: 19 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223969:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d0421c0800/0x9c34acc08badceae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223977:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0421c0800/0x9c34acc08badceae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.223997:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d0421c0800/0x9c34acc08badceae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.224004:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d0421c0800/0x9c34acc08badceae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.224010:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d0421c0800/0x9c34acc08badceae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.224016:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d0421c0800/0x9c34acc08badceae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.224022:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c0800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940515.224026:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d0421c0800/0x9c34acc08badceae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.224034:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d0421c0800/0x9c34acc08badceae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.224042:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d0421c0800/0x9c34acc08badceae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.224051:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940515.224073:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:3645:x1875839944773248:12345-0@lo:103: Request processed in 133us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940515.224080:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940515.224141:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944773248:0@lo:103: 00000100:00100000:0.0:1788940515.224150:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944773120:0@lo:103: 00000100:00100000:0.0:1788940515.224171:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944772992:0@lo:103: 00000100:00100000:0.0:1788940515.224187:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944772864:0@lo:103: 00000100:00100000:0.0:1788940515.224194:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944773376:0@lo:103: 00010000:00010000:3.0:1788940515.224521:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940515.224545:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584c800/0x9c34acc08badce6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badce68 expref: 18 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940515.224556:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875839944772224:0@lo:104: 00010000:00010000:3.0:1788940515.224565:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d000031e00/0x9c34acc08badce45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badce3e expref: 17 pid: 6512 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940515.224571:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875839944772352:0@lo:104: 00010000:00010000:3.0:1788940515.224580:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d000031600/0x9c34acc08badce29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badce22 expref: 16 pid: 6515 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940515.224586:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875839944772480:0@lo:104: 00010000:00010000:3.0:1788940515.224594:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d000031c00/0x9c34acc08badcdf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badcdea expref: 15 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940515.224602:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06102300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875839944772608:0@lo:104: 00010000:00010000:3.0:1788940515.224611:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d042052a00/0x9c34acc08badcd7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badcd73 expref: 14 pid: 6513 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940515.224632:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875839944772736:0@lo:104: 00010000:00010000:3.0:1788940515.224654:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d0421c0800/0x9c34acc08badceae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.224663:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d0421c0800/0x9c34acc08badceae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.224668:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d0421c0800/0x9c34acc08badceae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.224674:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0421c0800/0x9c34acc08badceae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788940515.224687:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788940515.226945:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+13:8430:x1875839944772096:12345-0@lo:253: Request processed in 13319us (13753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940515.226959:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788940515.228711:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944772096:0@lo:253: 10000000:01000000:3.0:1788940515.228731:0:8430:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788940515.228735:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788940515.228737:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788940515.228738:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940515.228739:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788940515.228740:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940515.228741:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940515.228742:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788940515.228744:0:8430:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788940515.228745:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940515.228747:0:8430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788940515.228771:0:8430:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91d035758800 from lustre-OST0000 10000000:01000000:3.0:1788940515.228882:0:8430:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788940515.228885:0:8430:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788940515.228894:0:8430:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91d00509b3b0 local copy 10000000:01000000:3.0:1788940515.228898:0:8430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788940515.228953:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badceb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.228966:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badceb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.228976:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badceb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940515.228995:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944773504:0@lo:101: 00000100:00100000:3.0:1788940515.229050:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940515.229129:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d035a3cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940515.229212:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944773504 00000100:00100000:0.0:1788940515.229219:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944773504 00000100:00100000:0.0:1788940515.229395:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788940515.229420:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+13:8430:x1875839944773504:12345-0@lo:101: 00010000:00010000:0.0:1788940515.229434:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940515.229449:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584da00/0x9c34acc08badcebc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badceb5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.229473:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584da00/0x9c34acc08badcebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badceb5 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.229486:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584da00/0x9c34acc08badcebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badceb5 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.229495:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584da00, rc 0) 00000100:00100000:0.0:1788940515.229542:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:8430:x1875839944773504:12345-0@lo:101: Request processed in 137us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940515.229548:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788940515.229613:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944773504:0@lo:101: 00010000:00010000:3.0:1788940515.229626:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badceb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9c34acc08badcebc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.229634:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badceb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9c34acc08badcebc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940515.229720:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944773632:0@lo:501: 00000100:00100000:3.0:1788940515.229747:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940515.230039:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d035a3cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940515.230114:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944773632 00000100:00100000:1.0:1788940515.230120:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944773632 00000100:00100000:1.0:1788940515.230146:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788940515.230153:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:8430:x1875839944773632:12345-0@lo:501: 00000100:00100000:1.0:1788940515.230227:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:8430:x1875839944773632:12345-0@lo:501: Request processed in 74us (478us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788940515.230234:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788940515.230390:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944773632:0@lo:501: 10000000:01000000:3.0:1788940515.230417:0:8430:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788940515.230437:0:8430:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788940515.230443:0:8430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badceb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9c34acc08badcebc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.230451:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badceb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9c34acc08badcebc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.230470:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badceb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9c34acc08badcebc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.230484:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788940515.230510:0:8430:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91d035758800 10000000:01000000:3.0:1788940515.230515:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788940515.230520:0:8430:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788940515.230523:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788940515.230527:0:8430:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788940515.230530:0:8430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788940515.230547:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c0e00/0x9c34acc08badcec3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.230554:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d0421c0e00/0x9c34acc08badcec3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.230562:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d0421c0e00/0x9c34acc08badcec3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940515.230576:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944773760:0@lo:101: 00000100:00100000:3.0:1788940515.230602:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940515.230621:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d035a3c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940515.230876:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944773760 00000100:00100000:1.0:1788940515.230881:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944773760 00000100:00100000:1.0:1788940515.230902:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788940515.230909:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:8430:x1875839944773760:12345-0@lo:101: 00010000:00010000:1.0:1788940515.230926:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940515.230938:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaaac00/0x9c34acc08badceca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcec3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.230954:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaaac00/0x9c34acc08badceca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcec3 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.230962:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaaac00/0x9c34acc08badceca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcec3 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.230969:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaaac00, rc 0) 00000100:00100000:1.0:1788940515.231008:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:8430:x1875839944773760:12345-0@lo:101: Request processed in 99us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940515.231014:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00010000:1.0:1788940515.231037:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940515.231043:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badceb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9c34acc08badcebc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.231050:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c0a00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940515.231054:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badceb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9c34acc08badcebc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.231063:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badceb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9c34acc08badcebc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940515.231070:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badceb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9c34acc08badcebc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940515.231075:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788940515.231092:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badceb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c34acc08badcebc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.231104:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940515.231124:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badceb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c34acc08badcebc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.231132:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badceb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c34acc08badcebc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.231145:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940515.231147:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940515.231148:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940515.231250:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944773760:0@lo:101: 00010000:00010000:3.0:1788940515.231296:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d0421c0e00/0x9c34acc08badcec3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badceca expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.231304:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d0421c0e00/0x9c34acc08badcec3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badceca expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940515.231375:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944774016:0@lo:501: 00000100:00100000:3.0:1788940515.231416:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940515.231436:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d035a3c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788940515.231593:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944774016 00000100:00100000:0.0:1788940515.231598:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944774016 00000100:00100000:0.0:1788940515.231623:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788940515.231631:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:8430:x1875839944774016:12345-0@lo:501: 00000100:00100000:0.0:1788940515.231740:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:8430:x1875839944774016:12345-0@lo:501: Request processed in 109us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940515.231747:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788940515.231792:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944773888:0@lo:103: 00000100:00100000:0.0:1788940515.231820:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940515.231864:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944773888 00000100:00100000:0.0:1788940515.231869:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944773888 00000100:00100000:0.0:1788940515.231896:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940515.231903:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:3648:x1875839944773888:12345-0@lo:103: 00010000:00010000:0.0:1788940515.231912:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940515.231924:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584da00/0x9c34acc08badcebc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badceb5 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.231935:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940515.231960:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:3648:x1875839944773888:12345-0@lo:103: Request processed in 58us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940515.231967:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940515.231991:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944773888:0@lo:103: 00000100:00100000:3.0:1788940515.232169:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944774016:0@lo:501: 00000100:00100000:3.0:1788940515.232198:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944774144:0@lo:503: 00000100:00100000:3.0:1788940515.232241:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940515.232294:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d035a3c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788940515.232375:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944774144 00000100:00100000:0.0:1788940515.232380:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944774144 00000100:00100000:0.0:1788940515.232548:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788940515.232556:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:8430:x1875839944774144:12345-0@lo:503: 00000100:00100000:0.0:1788940515.232649:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:8430:x1875839944774144:12345-0@lo:503: Request processed in 94us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940515.232656:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788940515.232809:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944774144:0@lo:503: 00000040:00080000:3.0:1788940515.233079:0:8430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788940515.233153:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944774272:0@lo:502: 00000100:00100000:3.0:1788940515.233187:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940515.233211:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d035a3c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940515.233388:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944774272 00000100:00100000:1.0:1788940515.233394:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944774272 00000100:00100000:1.0:1788940515.233431:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788940515.233438:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:8430:x1875839944774272:12345-0@lo:502: 00000100:00100000:1.0:1788940515.233540:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:8430:x1875839944774272:12345-0@lo:502: Request processed in 102us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940515.233548:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788940515.233691:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944774272:0@lo:502: 00000040:00080000:3.0:1788940515.233890:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788940515.233915:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788940515.233928:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788940515.233939:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788940515.233950:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788940515.233963:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788940515.233991:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944774400:0@lo:502: 00000100:00100000:3.0:1788940515.234025:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940515.234054:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d035a3c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940515.234392:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944774400 00000100:00100000:1.0:1788940515.234399:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944774400 00000100:00100000:1.0:1788940515.234432:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788940515.234439:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:8430:x1875839944774400:12345-0@lo:502: 00000100:00100000:1.0:1788940515.234519:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:8430:x1875839944774400:12345-0@lo:502: Request processed in 80us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940515.234526:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788940515.234670:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944774400:0@lo:502: 00000040:00080000:3.0:1788940515.234716:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788940515.234730:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788940515.235840:0:8453:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788940515.235858:0:8453:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788940515.235866:0:8453:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940515.235868:0:8453:0:(obd_config.c:1662:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788940515.235875:0:8453:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788940515.235892:0:8453:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000 (ffff91d0046433b0) 00000020:00000080:3.0:1788940515.235916:0:8453:0:(obd_config.c:786:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788940515.235923:0:8453:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788940515.236011:0:8453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d035758800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788940515.236019:0:8453:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788940515.236036:0:8453:0:(genops.c:1393:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9c34acc08badced8 00010000:00010000:3.0:1788940515.244707:0:8453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1788940515.245077:0:8453:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788940515.251729:0:8453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788940515.252449:0:8453:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788940515.260323:0:8453:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788940515.260735:0:8453:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788940515.268759:0:8453:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788940515.270145:0:8453:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788940515.270157:0:8453:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940515.270165:0:8453:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940515.270168:0:8453:0:(obd_config.c:1662:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788940515.270173:0:8453:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940515.270177:0:8453:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940515.270179:0:8453:0:(obd_config.c:1662:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788940515.270182:0:8453:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788940515.270184:0:8453:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788940515.270206:0:8453:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940515.270209:0:8453:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940515.270210:0:8453:0:(obd_config.c:1662:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788940515.270213:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788940515.272292:0:8430:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788940515.272339:0:8430:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788940515.272365:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c0e00/0x9c34acc08badcec3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badceca expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.272388:0:8430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d0421c0e00/0x9c34acc08badcec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badceca expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940515.272413:0:8430:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d035758800 from 1 10000000:01000000:1.0:1788940515.272417:0:8430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940515.272457:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaab600/0x9c34acc08badcedf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.272466:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02eaab600/0x9c34acc08badcedf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.272479:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02eaab600/0x9c34acc08badcedf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940515.272503:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944774528:0@lo:101: 00000100:00100000:1.0:1788940515.272568:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940515.272616:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d031079900 going to sleep for 11 seconds 00000100:00100000:3.0:1788940515.272888:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944774528 00000100:00100000:3.0:1788940515.272896:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944774528 00000100:00100000:3.0:1788940515.272939:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788940515.272949:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:8430:x1875839944774528:12345-0@lo:101: 00010000:00010000:3.0:1788940515.272963:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940515.272976:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0421c0800/0x9c34acc08badcee6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcedf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.272998:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0421c0800/0x9c34acc08badcee6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcedf expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.273009:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0421c0800/0x9c34acc08badcee6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcedf expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940515.273029:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0421c0800, rc 0) 00000100:00100000:3.0:1788940515.273073:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:8430:x1875839944774528:12345-0@lo:101: Request processed in 125us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940515.273080:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788940515.273225:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944774528:0@lo:101: 00010000:00010000:1.0:1788940515.273239:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02eaab600/0x9c34acc08badcedf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcee6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.273247:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02eaab600/0x9c34acc08badcedf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcee6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940515.273375:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944774656:0@lo:501: 00000100:00100000:1.0:1788940515.274614:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940515.274652:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d031079900 going to sleep for 11 seconds 00000100:00100000:3.0:1788940515.274749:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944774656 00000100:00100000:3.0:1788940515.274757:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944774656 00000100:00100000:3.0:1788940515.274863:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788940515.274872:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:8430:x1875839944774656:12345-0@lo:501: 00000100:00100000:3.0:1788940515.275003:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:8430:x1875839944774656:12345-0@lo:501: Request processed in 132us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940515.275011:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788940515.275104:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944774656:0@lo:501: 00000100:00100000:1.0:1788940515.275148:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944774784:0@lo:503: 00000100:00100000:1.0:1788940515.275190:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940515.275223:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d031079900 going to sleep for 11 seconds 00000100:00100000:3.0:1788940515.275365:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944774784 00000100:00100000:3.0:1788940515.275370:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944774784 00000100:00100000:3.0:1788940515.275397:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788940515.275531:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:8430:x1875839944774784:12345-0@lo:503: 00000100:00100000:3.0:1788940515.275617:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:8430:x1875839944774784:12345-0@lo:503: Request processed in 214us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940515.278005:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788940515.278202:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944774784:0@lo:503: 00000040:00080000:1.0:1788940515.278512:0:8430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788940515.278615:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944774912:0@lo:502: 00000100:00100000:1.0:1788940515.278679:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940515.278716:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d031079900 going to sleep for 11 seconds 00000100:00100000:1.0:1788940515.278738:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944774912 00000100:00100000:1.0:1788940515.278743:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944774912 00000100:00100000:1.0:1788940515.278964:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788940515.278975:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:8430:x1875839944774912:12345-0@lo:502: 00000100:00100000:1.0:1788940515.279083:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:8430:x1875839944774912:12345-0@lo:502: Request processed in 109us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940515.279090:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788940515.279137:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944774912:0@lo:502: 00000040:00080000:1.0:1788940515.279393:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788940515.280598:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788940515.280645:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944775040:0@lo:502: 00000100:00100000:1.0:1788940515.280709:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940515.280749:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d031079900 going to sleep for 11 seconds 00000100:00100000:3.0:1788940515.281044:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944775040 00000100:00100000:3.0:1788940515.281052:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944775040 00000100:00100000:3.0:1788940515.281106:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788940515.281116:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:8430:x1875839944775040:12345-0@lo:502: 00000100:00100000:3.0:1788940515.281230:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:8430:x1875839944775040:12345-0@lo:502: Request processed in 116us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940515.281239:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788940515.281350:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944775040:0@lo:502: 00000040:00080000:0.0:1788940515.281423:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788940515.281433:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788940515.282375:0:8457:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940515.282392:0:8457:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940515.282394:0:8457:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788940515.282417:0:8457:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d035758800 00000020:00000080:3.0:1788940515.282420:0:8457:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788940515.282433:0:8457:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940515.282436:0:8457:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940515.282438:0:8457:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788940515.282440:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788940515.283473:0:8430:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788940515.283505:0:8430:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788940515.283541:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaab600/0x9c34acc08badcedf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcee6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.283554:0:8430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02eaab600/0x9c34acc08badcedf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcee6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940515.283607:0:8430:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788940515.283610:0:8430:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91d035758800 10000000:01000000:0.0:1788940515.283614:0:8430:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91d035758800 10000000:01000000:0.0:1788940515.283617:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788940515.283624:0:8430:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91d035758800 from 1 10000000:01000000:0.0:1788940515.283626:0:8430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788940515.283660:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badceed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.283669:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badceed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.283681:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badceed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940515.283703:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944775168:0@lo:101: 00000100:00100000:0.0:1788940515.283765:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940515.283814:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310cc540 going to sleep for 11 seconds 00000100:00100000:1.0:1788940515.283892:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944775168 00000100:00100000:1.0:1788940515.283901:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944775168 00000100:00100000:1.0:1788940515.283943:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788940515.283952:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:8430:x1875839944775168:12345-0@lo:101: 00010000:00010000:1.0:1788940515.283976:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940515.283989:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaab000/0x9c34acc08badcef4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badceed expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.284012:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaab000/0x9c34acc08badcef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badceed expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.284024:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaab000/0x9c34acc08badcef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badceed expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.284033:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaab000, rc 0) 00000100:00100000:1.0:1788940515.284081:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:8430:x1875839944775168:12345-0@lo:101: Request processed in 130us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940515.284087:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788940515.284381:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944775168:0@lo:101: 00010000:00010000:0.0:1788940515.284396:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badceed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcef4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.284461:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badceed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcef4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940515.284559:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944775296:0@lo:501: 00000100:00100000:0.0:1788940515.284585:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940515.284610:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310cc540 going to sleep for 11 seconds 00000100:00100000:1.0:1788940515.284665:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944775296 00000100:00100000:1.0:1788940515.284670:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944775296 00000100:00100000:1.0:1788940515.284702:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788940515.284709:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:8430:x1875839944775296:12345-0@lo:501: 00000100:00100000:1.0:1788940515.284822:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:8430:x1875839944775296:12345-0@lo:501: Request processed in 113us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940515.284829:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788940515.284959:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944775296:0@lo:501: 00000100:00100000:0.0:1788940515.284987:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944775424:0@lo:503: 00000100:00100000:0.0:1788940515.285027:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940515.285052:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310cc540 going to sleep for 11 seconds 00000100:00100000:1.0:1788940515.285171:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944775424 00000100:00100000:1.0:1788940515.285176:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944775424 00000100:00100000:1.0:1788940515.285206:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788940515.285212:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:8430:x1875839944775424:12345-0@lo:503: 00000100:00100000:1.0:1788940515.285319:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:8430:x1875839944775424:12345-0@lo:503: Request processed in 105us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940515.285326:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788940515.286386:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944775424:0@lo:503: 00000040:00080000:0.0:1788940515.288372:0:8430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788940515.288924:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944775552:0@lo:502: 00000100:00100000:0.0:1788940515.289001:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940515.289042:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310cc540 going to sleep for 11 seconds 00000100:00100000:1.0:1788940515.289116:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944775552 00000100:00100000:1.0:1788940515.289125:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944775552 00000100:00100000:1.0:1788940515.289176:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788940515.289187:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:8430:x1875839944775552:12345-0@lo:502: 00000100:00100000:1.0:1788940515.289325:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:8430:x1875839944775552:12345-0@lo:502: Request processed in 140us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940515.289333:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788940515.289918:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944775552:0@lo:502: 00000040:00080000:0.0:1788940515.290183:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788940515.290214:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788940515.290228:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788940515.290241:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788940515.290254:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788940515.290289:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788940515.290301:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788940515.290312:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788940515.290327:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788940515.290340:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788940515.290354:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788940515.290366:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788940515.290381:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788940515.291891:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788940515.291938:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788940515.291953:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788940515.291966:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788940515.291979:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788940515.291990:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788940515.292002:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788940515.292014:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788940515.292027:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788940515.292063:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788940515.292078:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788940515.292090:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788940515.292103:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788940515.292115:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788940515.292127:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788940515.292140:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788940515.292152:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788940515.292164:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788940515.292176:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788940515.292189:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788940515.292201:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788940515.292213:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788940515.292224:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788940515.292236:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1788940515.292315:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944775680:0@lo:502: 00000100:00100000:0.0:1788940515.292392:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940515.293565:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310cc540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940515.293590:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944775680 00000100:00100000:0.0:1788940515.293598:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944775680 00000100:00100000:0.0:1788940515.293671:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788940515.293681:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:8430:x1875839944775680:12345-0@lo:502: 00000100:00100000:0.0:1788940515.294045:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:8430:x1875839944775680:12345-0@lo:502: Request processed in 364us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940515.294054:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788940515.294130:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944775680:0@lo:502: 00000040:00080000:2.0:1788940515.294210:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788940515.294222:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788940515.295094:0:8458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788940515.295111:0:8458:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91d0356099d8) 00000020:00000080:0.0:1788940515.295134:0:8458:0:(obd_config.c:786:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788940515.295226:0:8458:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d035758800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788940515.295231:0:8458:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d035758800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788940515.295233:0:8458:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d035758800 3 00010000:00080000:0.0:1788940515.295547:0:8458:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91cf060e3800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1788940515.299049:0:8458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1788940515.299367:0:8458:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788940515.299427:0:8458:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788940515.299443:0:8458:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9c34acc08badcf02 00000100:00080000:1.0:1788940515.299454:0:8458:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788940515.299460:0:8458:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91cf060e3800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940515.299498:0:8458:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03475a680 x1875839944775808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940515.299521:0:8458:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788940515.299692:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944776064:0@lo:400: 00000100:00100000:0.0:1788940515.299759:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940515.299807:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940515.299813:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944775936:0@lo:400: 00000100:00100000:0.0:1788940515.299839:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940515.299878:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944776192:0@lo:400: 00000100:00100000:0.0:1788940515.299901:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940515.299918:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940515.299924:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944776320:0@lo:400: 00000100:00100000:0.0:1788940515.299944:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940515.299979:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944776064 00000100:00100000:0.0:1788940515.299986:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944776064 00000100:00100000:0.0:1788940515.300019:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944776320 00000100:00100000:0.0:1788940515.300022:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944776320 00000100:00100000:0.0:1788940515.300039:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788940515.300047:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944776064:12345-0@lo:400: 00000100:00100000:0.0:1788940515.300102:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944776064:12345-0@lo:400: Request processed in 55us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940515.300124:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788940515.300139:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788940515.300146:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944776320:12345-0@lo:400: 00000100:00100000:0.0:1788940515.300180:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944776320:12345-0@lo:400: Request processed in 35us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940515.300186:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788940515.300206:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944775936 00000100:00100000:0.0:1788940515.300210:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944775936 00000100:00100000:0.0:1788940515.300233:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944776192 00000100:00100000:0.0:1788940515.300236:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944776192 00000100:00100000:0.0:1788940515.300248:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788940515.300253:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944775936:12345-0@lo:400: 00000100:00100000:0.0:1788940515.300302:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944775936:12345-0@lo:400: Request processed in 49us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940515.300309:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788940515.300322:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788940515.300328:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944776192:12345-0@lo:400: 00000100:00100000:0.0:1788940515.300356:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944776192:12345-0@lo:400: Request processed in 28us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940515.300362:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788940515.300408:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944776320:0@lo:400: 00010000:00080000:0.0:1788940515.300422:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91cf06109f80 x1875839944776192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940515.300432:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944776192:0@lo:400: 00010000:00080000:0.0:1788940515.300460:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91cf06108700 x1875839944775936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940515.300477:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944775936:0@lo:400: 00000100:00100000:0.0:1788940515.300490:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944776064:0@lo:400: 00000100:00100000:2.0:1788940515.301134:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875839944775808:0@lo:38: 00000100:00100000:2.0:1788940515.301179:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940515.301315:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944775808 00000100:00100000:0.0:1788940515.301321:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944775808 00000100:00100000:0.0:1788940515.301357:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788940515.301363:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1875839944775808:12345-0@lo:38: 00010000:00080000:0.0:1788940515.301386:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:0.0:1788940515.301562:0:6521:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9c34acc08badcf09 00000004:00100000:0.0:1788940515.301577:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788940515.301612:0:6521:0:(import.c:65:import_set_state_nolock()) ffff91cf060e6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940515.301663:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875839944775808:12345-0@lo:38: Request processed in 298us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940515.301670:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788940515.301754:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d03475a680 x1875839944775808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940515.301763:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788940515.301770:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788940515.301789:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788940515.301794:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788940515.301806:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf060e3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788940515.301813:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875839944775808:0@lo:38: 00000020:01000004:1.0:1788940515.303899:0:8458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788940515.303940:0:8458:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff91cf06cdcd88) 00000020:00000080:1.0:1788940515.303969:0:8458:0:(obd_config.c:786:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788940515.304116:0:8458:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d035758800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788940515.304121:0:8458:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d035758800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788940515.304124:0:8458:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d035758800 3 00010000:00080000:1.0:1788940515.304156:0:8458:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d02ebf3800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1788940515.308085:0:8458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1788940515.309622:0:8458:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788940515.309680:0:8458:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788940515.309696:0:8458:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x9c34acc08badcf17 00000100:00080000:1.0:1788940515.309709:0:8458:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788940515.309726:0:8458:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff91d02ebf3800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940515.309766:0:8458:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03475a680 x1875839944776448/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940515.310732:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875839944776448:0@lo:38: 00000100:00100000:2.0:1788940515.310823:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788940515.310881:0:8458:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788940515.315909:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944776448 00000100:00100000:0.0:1788940515.315926:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944776448 00000100:00100000:0.0:1788940515.316951:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940515.316962:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875839944776448:12345-0@lo:38: 00010000:00080000:0.0:1788940515.316998:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:0.0:1788940515.317050:0:6522:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x9c34acc08badcf1e 00000004:00100000:0.0:1788940515.317069:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788940515.317112:0:6522:0:(import.c:65:import_set_state_nolock()) ffff91cf060e4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940515.317222:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875839944776448:12345-0@lo:38: Request processed in 260us (6398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940515.317230:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788940515.317335:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d03475a680 x1875839944776448/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940515.317348:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788940515.317356:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788940515.317364:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788940515.317370:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788940515.317372:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02ebf3800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788940515.317378:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875839944776448:0@lo:38: 00000040:00080000:1.0:1788940515.320912:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1788940515.321068:0:8430:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788940515.321100:0:8430:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788940515.321125:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badceed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcef4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940515.321141:0:8430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badceed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcef4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788940515.321192:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788940515.321194:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788940515.321195:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940515.321197:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940515.321198:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940515.321199:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940515.321201:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940515.321203:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940515.321204:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940515.321211:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940515.321213:0:8430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788940515.321216:0:8430:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788940515.321219:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940515.321220:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788940515.321221:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940515.321222:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940515.321223:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940515.321224:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940515.321225:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940515.321226:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940515.321226:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940515.321227:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940515.321228:0:8430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788940515.321278:0:8430:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788940515.321298:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944776576:0@lo:253: 00000100:00100000:2.0:1788940515.321373:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940515.321540:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02004fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940515.321780:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944776576 00000100:00100000:0.0:1788940515.321795:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944776576 00000100:00100000:0.0:1788940515.321863:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788940515.321874:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:8430:x1875839944776576:12345-0@lo:253: 20000000:01000000:0.0:1788940515.321907:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788940515.321923:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788940515.347596:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788940515.347611:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788940515.348108:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:8430:x1875839944776576:12345-0@lo:253: Request processed in 26231us (26730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940515.348122:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 20000000:01000000:0.0:1788940515.348295:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788940515.348300:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788940515.348323:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d03584d400/0x9c34acc08badcf25 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.348339:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d000031000/0x9c34acc08badce1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badce14 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.348348:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d0027f6600/0x9c34acc08badce37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badce30 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.348356:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d03584d400/0x9c34acc08badcf25 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.348394:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d0027f6600/0x9c34acc08badce37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badce30 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.348420:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d0027f6600/0x9c34acc08badce37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badce30 expref: 15 pid: 6512 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940515.348433:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875839944776704:0@lo:104: 00000100:00100000:0.0:1788940515.348474:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788940515.348539:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d000031000/0x9c34acc08badce1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badce14 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.348549:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d000031000/0x9c34acc08badce1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badce14 expref: 15 pid: 6512 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940515.348575:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875839944776832:0@lo:104: 00000100:00100000:2.0:1788940515.348590:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:8430:1875839944776576:0@lo:253: 00000100:00100000:0.0:1788940515.348600:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310ccc00 going to sleep for 11 seconds 10000000:01000000:2.0:1788940515.348615:0:8430:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788940515.348622:0:8430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788940515.348624:0:8430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788940515.348627:0:8430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940515.348629:0:8430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940515.348631:0:8430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940515.348633:0:8430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940515.348635:0:8430:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940515.348637:0:8430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940515.348638:0:8430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940515.348640:0:8430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940515.348642:0:8430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788940515.348661:0:8430:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788940515.348899:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788940515.348922:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940515.348956:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944776704 00000100:00100000:1.0:1788940515.348963:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944776704 00000100:00100000:1.0:1788940515.348994:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944776832 00000100:00100000:1.0:1788940515.348997:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944776832 00000100:00100000:1.0:1788940515.349009:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788940515.349016:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035846850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:6536:x1875839944776704:12345-0@lo:104: 00010000:00010000:1.0:1788940515.349029:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badce30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badce37 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.349085:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788940515.349091:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035846850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:6536:x1875839944776704:12345-0@lo:104: Request processed in 76us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940515.349097:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788940515.349133:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940515.349139:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:6536:x1875839944776832:12345-0@lo:104: 00010000:00010000:1.0:1788940515.349146:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badce14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badce1b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.349186:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788940515.349192:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:6536:x1875839944776832:12345-0@lo:104: Request processed in 53us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940515.349198:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788940515.349214:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940515.349221:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badce30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badce37 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.349228:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c1c00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940515.349232:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badce30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badce37 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.349241:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badce30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badce37 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940515.349248:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badce30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badce37 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940515.349254:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788940515.349305:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badce30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce37 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.349312:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940515.349329:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badce30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce37 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.349337:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badce30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce37 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.349362:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940515.349366:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badce14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badce1b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.349371:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c1200 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940515.349374:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badce14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badce1b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.349381:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badce14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badce1b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940515.349387:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badce14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badce1b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940515.349392:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788940515.349423:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badce14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce1b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.349429:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940515.349435:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badce14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce1b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.349443:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badce14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce1b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940515.349456:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940515.349458:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940515.349460:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940515.349467:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940515.349493:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944776960:0@lo:103: 00000100:00100000:1.0:1788940515.349522:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940515.349549:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940515.349555:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944777088:0@lo:103: 00000100:00100000:1.0:1788940515.349576:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940515.350008:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944776960 00000100:00100000:0.0:1788940515.350014:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944776960 00010000:00010000:0.0:1788940515.350036:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d0027f6600/0x9c34acc08badce37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badce30 expref: 16 pid: 6512 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940515.350066:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944777088 00000100:00100000:0.0:1788940515.350069:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944777088 00010000:00010000:0.0:1788940515.350081:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d000031000/0x9c34acc08badce1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badce14 expref: 17 pid: 6512 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940515.350106:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940515.350114:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034759180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:3645:x1875839944776960:12345-0@lo:103: 00010000:00010000:0.0:1788940515.350125:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940515.350129:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d0027f6600/0x9c34acc08badce37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badce30 expref: 17 pid: 6512 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.350140:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d0027f6600/0x9c34acc08badce37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badce30 expref: 17 pid: 6512 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.350156:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940515.350191:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034759180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:3645:x1875839944776960:12345-0@lo:103: Request processed in 78us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940515.350198:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940515.350212:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788940515.350218:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:3645:x1875839944777088:12345-0@lo:103: 00010000:00010000:0.0:1788940515.350225:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940515.350236:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d000031000/0x9c34acc08badce1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badce14 expref: 16 pid: 6512 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.350245:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d000031000/0x9c34acc08badce1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badce14 expref: 16 pid: 6512 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.350284:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d03584d400/0x9c34acc08badcf25 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.350294:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584d400/0x9c34acc08badcf25 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788940515.350310:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013436003s 00010000:00010000:0.0:1788940515.350314:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d03584d400/0x9c34acc08badcf25 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.350321:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d03584d400/0x9c34acc08badcf25 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.350328:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d03584d400/0x9c34acc08badcf25 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.350335:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d03584d400/0x9c34acc08badcf25 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.350342:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584d400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940515.350346:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d03584d400/0x9c34acc08badcf25 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.350353:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d03584d400/0x9c34acc08badcf25 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.350363:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d03584d400/0x9c34acc08badcf25 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.350379:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940515.350513:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:3645:x1875839944777088:12345-0@lo:103: Request processed in 187us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940515.350522:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788940515.350565:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944777088:0@lo:103: 00000100:00100000:0.0:1788940515.350575:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944776960:0@lo:103: 00010000:00010000:0.0:1788940515.350610:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0027f6600/0x9c34acc08badce37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badce30 expref: 15 pid: 6512 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940515.350622:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875839944776704:0@lo:104: 00010000:00010000:0.0:1788940515.350632:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d000031000/0x9c34acc08badce1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badce14 expref: 14 pid: 6512 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940515.350640:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875839944776832:0@lo:104: 00010000:00010000:0.0:1788940515.350653:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d03584d400/0x9c34acc08badcf25 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.350662:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d03584d400/0x9c34acc08badcf25 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.350668:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d03584d400/0x9c34acc08badcf25 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940515.350675:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584d400/0x9c34acc08badcf25 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788940515.362365:0:8430:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788940515.365082:0:8430:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788940515.367756:0:8430:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788940515.368084:0:8430:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788940515.373597:0:8430:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788940515.373941:0:8430:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788940515.379072:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788940515.400546:0:8430:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788940515.400556:0:8430:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788940515.400593:0:8430:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788940515.400633:0:8430:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788940515.400654:0:8430:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788940515.400679:0:8430:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788940515.401686:0:8430:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788940515.401885:0:8430:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788940515.616054:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940516.518450:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940516.518487:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944777216:0@lo:41: 00000100:00100000:2.0:1788940516.518602:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940516.518763:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944777216 00000100:00100000:0.0:1788940516.518781:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944777216 00000100:00100000:0.0:1788940516.518853:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788940516.518865:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944777216:12345-0@lo:41: 00000004:00000024:0.0:1788940516.518911:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1788940516.518980:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944777216:12345-0@lo:41: Request processed in 116us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940516.518987:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788940516.519094:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944777216:0@lo:41: 00010000:00010000:0.0:1788940516.635761:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788940516.891373:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788940516.891385:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91d034739000 from 30 10000000:01000000:1.0:1788940516.891392:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788940516.891454:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badcf2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.891469:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badcf2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.891483:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badcf2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940516.891516:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944777344:0@lo:101: 00000100:00100000:1.0:1788940516.891617:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940516.891686:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940516.893317:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944777344 00000100:00100000:0.0:1788940516.893337:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944777344 00000100:00100000:0.0:1788940516.894063:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788940516.894082:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:6517:x1875839944777344:12345-0@lo:101: 00010000:00010000:0.0:1788940516.894108:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940516.894134:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584cc00/0x9c34acc08badcf33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcf2c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940516.894564:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584cc00/0x9c34acc08badcf33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcf2c expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940516.894582:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584cc00/0x9c34acc08badcf33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcf2c expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940516.894596:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584cc00, rc 0) 00000100:00100000:0.0:1788940516.894711:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:6517:x1875839944777344:12345-0@lo:101: Request processed in 633us (3091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940516.894721:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788940516.894846:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944777344:0@lo:101: 00010000:00010000:0.0:1788940516.896253:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badcf2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcf33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940516.896304:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badcf2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcf33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940516.897322:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944777472:0@lo:501: 00000100:00100000:0.0:1788940516.898299:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940516.898418:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d024a26cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940516.901058:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944777472 00000100:00100000:1.0:1788940516.901079:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944777472 00000100:00100000:1.0:1788940516.901160:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788940516.901174:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:6517:x1875839944777472:12345-0@lo:501: 00000100:00100000:1.0:1788940516.901444:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:6517:x1875839944777472:12345-0@lo:501: Request processed in 273us (3147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940516.901454:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788940516.901537:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944777472:0@lo:501: 00000100:00100000:1.0:1788940516.901607:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944777600:0@lo:503: 00000100:00100000:1.0:1788940516.901666:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940516.901693:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310b30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940516.901711:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944777600 00000100:00100000:1.0:1788940516.901715:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944777600 00000100:00100000:1.0:1788940516.901743:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788940516.901751:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:6517:x1875839944777600:12345-0@lo:503: 00000100:00100000:1.0:1788940516.901863:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:6517:x1875839944777600:12345-0@lo:503: Request processed in 112us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940516.901871:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788940516.901918:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944777600:0@lo:503: 00000100:00100000:1.0:1788940516.902151:0:8508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8508:1875839944777728:0@lo:502: 00000100:00100000:1.0:1788940516.902186:0:8508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940516.902206:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944777728 00000100:00100000:1.0:1788940516.902211:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944777728 00000100:00100000:1.0:1788940516.902232:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788940516.902239:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:8508:x1875839944777728:12345-0@lo:502: 00000100:00100000:1.0:1788940516.902336:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:8508:x1875839944777728:12345-0@lo:502: Request processed in 97us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940516.902343:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788940516.902372:0:8508:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb069c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940516.902386:0:8508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8508:1875839944777728:0@lo:502: 00000100:00100000:1.0:1788940516.902433:0:8508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8508:1875839944777856:0@lo:502: 00000100:00100000:1.0:1788940516.902468:0:8508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940516.902493:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944777856 00000100:00100000:1.0:1788940516.902498:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944777856 00000100:00100000:1.0:1788940516.902520:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788940516.902526:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:8508:x1875839944777856:12345-0@lo:502: 00000100:00100000:1.0:1788940516.902583:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:8508:x1875839944777856:12345-0@lo:502: Request processed in 56us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940516.902589:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788940516.902617:0:8508:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb069c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940516.902629:0:8508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8508:1875839944777856:0@lo:502: 00000040:00080000:1.0:1788940516.902649:0:8508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788940516.902715:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788940516.902740:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788940516.902752:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badcf2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcf33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.902766:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badcf2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcf33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940516.902779:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788940516.902782:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d034739000 from 5 10000000:01000000:1.0:1788940516.902786:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788940516.902819:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badcf3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.902842:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badcf3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.902854:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badcf3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940516.902880:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944777984:0@lo:101: 00000100:00100000:1.0:1788940516.902908:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940516.902922:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb069c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940516.902934:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944777984 00000100:00100000:1.0:1788940516.902938:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944777984 00000100:00100000:1.0:1788940516.902961:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788940516.902968:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:6517:x1875839944777984:12345-0@lo:101: 00010000:00010000:1.0:1788940516.902978:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940516.902994:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaaba00/0x9c34acc08badcf41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcf3a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.903019:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaaba00/0x9c34acc08badcf41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcf3a expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.903031:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaaba00/0x9c34acc08badcf41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcf3a expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.903042:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaaba00, rc 0) 00000100:00100000:1.0:1788940516.903070:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944777984:12345-0@lo:101: Request processed in 102us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940516.903077:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788940516.903108:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944777984:0@lo:101: 00010000:00010000:1.0:1788940516.903123:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badcf3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcf41 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.903133:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badcf3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcf41 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940516.903189:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944778112:0@lo:256: 00000100:00100000:1.0:1788940516.903222:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940516.903236:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb069c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940516.903250:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944778112 00000100:00100000:1.0:1788940516.903277:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944778112 00000100:00100000:1.0:1788940516.903305:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788940516.903314:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944778112:12345-0@lo:256: 20000000:01000000:1.0:1788940516.903329:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788940516.903348:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788940516.903352:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788940516.903431:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944778112:12345-0@lo:256: Request processed in 118us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940516.903437:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788940516.903468:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944778112:0@lo:256: 10000000:01000000:1.0:1788940516.903510:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788940516.903515:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badcf3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcf41 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.903522:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badcf3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcf41 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940516.903530:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788940516.903532:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1788940516.903534:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788940516.903549:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaaaa00/0x9c34acc08badcf48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.903566:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02eaaaa00/0x9c34acc08badcf48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.903573:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02eaaaa00/0x9c34acc08badcf48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940516.903584:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944778240:0@lo:101: 00000100:00100000:1.0:1788940516.903609:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940516.903622:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb069c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940516.903632:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944778240 00000100:00100000:1.0:1788940516.903636:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944778240 00000100:00100000:1.0:1788940516.903656:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788940516.903662:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944778240:12345-0@lo:101: 00010000:00010000:1.0:1788940516.903669:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940516.903679:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaab200/0x9c34acc08badcf4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcf48 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.903693:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaab200/0x9c34acc08badcf4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcf48 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.903701:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaab200/0x9c34acc08badcf4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcf48 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.903707:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaab200, rc 0) 00000100:00100000:1.0:1788940516.903732:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944778240:12345-0@lo:101: Request processed in 71us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940516.903738:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788940516.903766:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944778240:0@lo:101: 00010000:00010000:1.0:1788940516.903783:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02eaaaa00/0x9c34acc08badcf48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcf4f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.903791:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02eaaaa00/0x9c34acc08badcf48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcf4f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940516.910459:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944778368:0@lo:501: 00000100:00100000:1.0:1788940516.910564:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940516.910626:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb069c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940516.910878:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944778368 00000100:00100000:2.0:1788940516.910888:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944778368 00000100:00100000:2.0:1788940516.910958:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788940516.910969:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944778368:12345-0@lo:501: 00000100:00100000:2.0:1788940516.911174:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944778368:12345-0@lo:501: Request processed in 207us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940516.911183:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788940516.911473:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944778368:0@lo:501: 00000100:00100000:3.0:1788940516.911528:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944778496:0@lo:503: 00000100:00100000:3.0:1788940516.911586:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940516.911610:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06e5d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788940516.911680:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944778496 00000100:00100000:1.0:1788940516.911686:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944778496 00000100:00100000:1.0:1788940516.911728:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788940516.911736:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944778496:12345-0@lo:503: 00000100:00100000:1.0:1788940516.911847:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944778496:12345-0@lo:503: Request processed in 112us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940516.911855:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788940516.911901:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944778496:0@lo:503: 00000100:00100000:1.0:1788940516.912140:0:8510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8510:1875839944778624:0@lo:502: 00000100:00100000:1.0:1788940516.912178:0:8510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940516.912199:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944778624 00000100:00100000:1.0:1788940516.912203:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944778624 00000100:00100000:1.0:1788940516.912223:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788940516.912230:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:8510:x1875839944778624:12345-0@lo:502: 00000100:00100000:1.0:1788940516.912340:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:8510:x1875839944778624:12345-0@lo:502: Request processed in 109us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940516.912348:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788940516.912384:0:8510:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940516.912396:0:8510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8510:1875839944778624:0@lo:502: 00000020:01000000:1.0:1788940516.912420:0:8510:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788940516.912430:0:8510:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788940516.912439:0:8510:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940516.912441:0:8510:0:(obd_config.c:1662:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788940516.912447:0:8510:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788940516.912451:0:8510:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:1.0:1788940516.912479:0:8510:0:(obd_config.c:2073:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788940516.912481:0:8510:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788940516.912500:0:8510:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff91cf06cdb3b0) 00000020:00000080:1.0:1788940516.912528:0:8510:0:(obd_config.c:786:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1788940516.912534:0:8510:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788940516.912625:0:8510:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788940516.912633:0:8510:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788940516.912642:0:8510:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9c34acc08badcf5d 00010000:00080000:1.0:1788940516.912687:0:8510:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d03ec10000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1788940516.912967:0:8510:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788940516.933652:0:8510:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788940516.933682:0:8510:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788940516.933989:0:8510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788940516.934334:0:8510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788940516.934473:0:8510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788940516.934569:0:8510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788940516.935285:0:8514:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788940516.935292:0:8514:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788940516.935914:0:8510:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788940516.935928:0:8510:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788940516.935974:0:8510:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788940516.936001:0:8510:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08badcf64 00000100:00080000:2.0:1788940516.936014:0:8510:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788940516.936021:0:8510:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff91d03ec10000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788940516.936067:0:8510:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d0042b1180 x1875839944778752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788940516.936096:0:8510:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788940516.936311:0:8510:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940516.936316:0:8510:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940516.936318:0:8510:0:(obd_config.c:1662:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788940516.936321:0:8510:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940516.936332:0:8510:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940516.936334:0:8510:0:(obd_config.c:1662:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788940516.936338:0:8510:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788940516.936340:0:8510:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788940516.936375:0:8510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8510:1875839944779648:0@lo:502: 00000100:00100000:2.0:1788940516.936485:0:8510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940516.936532:0:8510:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d004e06a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940516.936620:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944778752:0@lo:8: 00000100:00100000:3.0:1788940516.936661:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940516.936747:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944778752 00000100:00100000:2.0:1788940516.936755:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944778752 00000100:00100000:2.0:1788940516.936794:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940516.936802:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06102300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875839944778752:12345-0@lo:8: 00010000:00080000:2.0:1788940516.936843:0:8437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:2.0:1788940516.936870:0:8437:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08badcf6b 00002000:00100000:2.0:1788940516.936906:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff91cf01fd8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788940516.936910:0:8437:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1788940516.936915:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788940516.936985:0:8437:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788940516.937219:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788940516.937248:0:8437:0:(import.c:65:import_set_state_nolock()) ffff91cf01fde800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940516.937334:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06102300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875839944778752:12345-0@lo:8: Request processed in 530us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940516.937343:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788940516.937458:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d0042b1180 x1875839944778752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788940526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940516.937470:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788940516.937486:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788940516.937495:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788940516.937501:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788940516.937504:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03ec10000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788940516.937514:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788940516.937520:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944778752:0@lo:8: 00000100:00100000:2.0:1788940516.937603:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8515:1875839944779776:0@lo:700: 00000100:00100000:2.0:1788940516.937633:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940516.937657:0:8515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d005296000 going to sleep for 11 seconds 00000004:00080000:2.0:1788940516.937672:0:8514:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788940516.937729:0:8514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 272270471921ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788940516.937737:0:8514:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788940516.937813:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944779776 00000100:00100000:3.0:1788940516.937819:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944779776 00000100:00100000:3.0:1788940516.937879:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940516.937887:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8515:x1875839944779776:12345-0@lo:700: 00000100:00100000:3.0:1788940516.937919:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8445:1875839944779904:0@lo:700: 00000100:00100000:3.0:1788940516.937953:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940516.937969:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06e5dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940516.937992:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944779904 00000100:00100000:3.0:1788940516.937995:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944779904 00000100:00100000:3.0:1788940516.938021:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940516.938027:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8445:x1875839944779904:12345-0@lo:700: 00000100:00080000:2.0:1788940516.938165:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940516.938171:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940516.938373:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944779648 00000100:00100000:2.0:1788940516.938379:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944779648 00000100:00100000:2.0:1788940516.938472:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788940516.938481:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:8510:x1875839944779648:12345-0@lo:502: 00000100:00100000:2.0:1788940516.938628:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:8510:x1875839944779648:12345-0@lo:502: Request processed in 148us (2143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940516.938636:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788940516.938732:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944779264:0@lo:400: 00000100:00100000:2.0:1788940516.938765:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940516.938852:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788940516.938859:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944778880:0@lo:400: 00000100:00100000:2.0:1788940516.938887:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940516.938911:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944779392:0@lo:400: 00000100:00100000:2.0:1788940516.938931:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940516.938981:0:8510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8510:1875839944779648:0@lo:502: 00000020:01000000:2.0:1788940516.939021:0:8510:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940516.939030:0:8510:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940516.939033:0:8510:0:(obd_config.c:1662:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788940516.939038:0:8510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:3.0:1788940516.939236:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944779264 00000100:00100000:3.0:1788940516.939241:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944779264 00000100:00100000:3.0:1788940516.939405:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788940516.939417:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944779264:12345-0@lo:400: 00000100:00100000:3.0:1788940516.939481:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944779264:12345-0@lo:400: Request processed in 68us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940516.939488:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788940516.939581:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944779008:0@lo:400: 00000100:00100000:0.0:1788940516.939676:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940516.939701:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944778880 00000100:00100000:1.0:1788940516.939708:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944778880 00000100:00100000:0.0:1788940516.939735:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944779520:0@lo:400: 00000100:00100000:1.0:1788940516.939757:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944779392 00000100:00100000:1.0:1788940516.939763:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944779392 00000100:00100000:0.0:1788940516.939780:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940516.939789:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944779520 00000100:00100000:1.0:1788940516.939794:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944779520 00000100:00100000:0.0:1788940516.939812:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940516.939821:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944779136:0@lo:400: 00000100:00100000:0.0:1788940516.939864:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940516.939876:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944779008 00000100:00100000:3.0:1788940516.939883:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944779008 00000100:00100000:3.0:1788940516.939921:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788940516.939939:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944779008:12345-0@lo:400: 00000100:00100000:3.0:1788940516.939992:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944779008:12345-0@lo:400: Request processed in 54us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940516.940000:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788940516.940049:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944779008:0@lo:400: 00000100:00100000:1.0:1788940516.940102:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944779136 00000100:00100000:1.0:1788940516.940107:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944779136 00000100:00100000:1.0:1788940516.940132:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788940516.940141:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944778880:12345-0@lo:400: 00000100:00100000:1.0:1788940516.940189:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944778880:12345-0@lo:400: Request processed in 49us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940516.940209:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788940516.940347:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03588f800 x1875839944778880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940516.940365:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944778880:0@lo:400: 00000100:00100000:2.0:1788940516.940385:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944779264:0@lo:400: 00000100:00100000:0.0:1788940516.940768:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788940516.940782:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788940516.940793:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3647:x1875839944779392:12345-0@lo:400: 00000100:00100000:1.0:1788940516.940802:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944779520:12345-0@lo:400: 00000100:00100000:1.0:1788940516.940881:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944779520:12345-0@lo:400: Request processed in 87us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940516.940888:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788940516.940909:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788940516.940909:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3647:x1875839944779392:12345-0@lo:400: Request processed in 126us (1974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940516.940924:0:6520:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788940516.940931:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000020:01000000:1.0:1788940516.940955:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 00000100:00100000:0.0:1788940516.940968:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788940516.940979:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944779136:12345-0@lo:400: 10000000:01000000:1.0:1788940516.940994:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788940516.941009:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaaaa00/0x9c34acc08badcf48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcf4f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940516.941023:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944779136:12345-0@lo:400: Request processed in 44us (1155us total) trans 0 rc 0/0 00010000:00010000:1.0:1788940516.941028:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02eaaaa00/0x9c34acc08badcf48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcf4f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940516.941036:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 10000000:01000000:1.0:1788940516.941056:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788940516.941059:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91d004f4a000 from 30 10000000:01000000:1.0:1788940516.941063:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788940516.941105:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badcf72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.941113:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badcf72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.941126:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badcf72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940516.941149:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944780032:0@lo:101: 00000100:00100000:1.0:1788940516.941221:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940516.941369:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06300 going to sleep for 11 seconds 00010000:00080000:2.0:1788940516.941460:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03588c000 x1875839944779392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940516.941488:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944779392:0@lo:400: 00000100:00100000:0.0:1788940516.941731:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944780032 00000100:00100000:0.0:1788940516.941741:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944780032 00000100:00100000:0.0:1788940516.941804:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788940516.941814:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944780032:12345-0@lo:101: 00010000:00010000:0.0:1788940516.941839:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940516.941857:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584d200/0x9c34acc08badcf79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcf72 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940516.941884:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584d200/0x9c34acc08badcf79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcf72 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940516.941899:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584d200/0x9c34acc08badcf79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcf72 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940516.941909:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584d200, rc 0) 00010000:00080000:3.0:1788940516.941936:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03588ca80 x1875839944779136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940516.941952:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944779136:0@lo:400: 00000100:00100000:0.0:1788940516.941967:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944780032:12345-0@lo:101: Request processed in 153us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940516.941975:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:3.0:1788940516.941981:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03588e680 x1875839944779520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940516.941995:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944779520:0@lo:400: 00000100:00100000:1.0:1788940516.943170:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944780032:0@lo:101: 00010000:00010000:1.0:1788940516.943198:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badcf72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcf79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.943212:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badcf72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcf79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940516.943401:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944780160:0@lo:501: 00000100:00100000:1.0:1788940516.943464:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940516.943563:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06300 going to sleep for 11 seconds 00000100:00080000:1.0:1788940516.943589:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788940516.943934:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944780160 00000100:00100000:3.0:1788940516.943943:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944780160 00000100:00100000:3.0:1788940516.944043:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788940516.944057:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944780160:12345-0@lo:501: 00000100:00100000:3.0:1788940516.944244:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944780160:12345-0@lo:501: Request processed in 189us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940516.944252:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788940516.944404:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944780160:0@lo:501: 00000100:00100000:3.0:1788940516.944459:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944780288:0@lo:503: 00000100:00100000:3.0:1788940516.947112:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940516.947175:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06e5d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940516.947212:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944780288 00000100:00100000:3.0:1788940516.947222:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944780288 00000100:00100000:3.0:1788940516.947319:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788940516.947333:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944780288:12345-0@lo:503: 00000004:00080000:2.0:1788940516.947462:0:7452:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788940516.947494:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944780288:12345-0@lo:503: Request processed in 164us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940516.947503:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788940516.947568:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944780288:0@lo:503: 00000100:00100000:3.0:1788940516.947822:0:8519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8519:1875839944780416:0@lo:502: 00000100:00100000:3.0:1788940516.947880:0:8519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940516.947910:0:8519:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06e5d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940516.947954:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944780416 00000100:00100000:2.0:1788940516.947967:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944780416 00000100:00100000:2.0:1788940516.948042:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788940516.948056:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:8519:x1875839944780416:12345-0@lo:502: 00000100:00100000:2.0:1788940516.948292:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:8519:x1875839944780416:12345-0@lo:502: Request processed in 239us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940516.948301:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788940516.948349:0:8519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8519:1875839944780416:0@lo:502: 00000100:00100000:0.0:1788940516.948500:0:8519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8519:1875839944780544:0@lo:502: 00000100:00100000:0.0:1788940516.948555:0:8519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940516.948604:0:8519:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d024a26f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940516.948656:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944780544 00000100:00100000:2.0:1788940516.948662:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944780544 00000100:00100000:2.0:1788940516.948904:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788940516.948915:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:8519:x1875839944780544:12345-0@lo:502: 00000100:00100000:2.0:1788940516.949006:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:8519:x1875839944780544:12345-0@lo:502: Request processed in 93us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940516.949013:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788940516.955512:0:8519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8519:1875839944780544:0@lo:502: 00000040:00080000:0.0:1788940516.955573:0:8519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788940516.955837:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788940516.955867:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788940516.955879:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badcf72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcf79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940516.955891:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badcf72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcf79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940516.955904:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788940516.955907:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d004f4a000 from 5 10000000:01000000:2.0:1788940516.955911:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788940516.956388:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042052c00/0x9c34acc08badcf80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940516.956399:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d042052c00/0x9c34acc08badcf80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940516.956408:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d042052c00/0x9c34acc08badcf80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940516.956429:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944780672:0@lo:101: 00000100:00100000:2.0:1788940516.956499:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940516.956546:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d018b2da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940516.957062:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944780672 00000100:00100000:1.0:1788940516.957082:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944780672 00000100:00100000:1.0:1788940516.957168:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788940516.957181:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944780672:12345-0@lo:101: 00010000:00010000:1.0:1788940516.957203:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940516.957227:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badcf87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcf80 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.957292:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badcf87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcf80 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.957306:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badcf87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcf80 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.957317:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaaae00, rc 0) 00000100:00100000:1.0:1788940516.957410:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:6517:x1875839944780672:12345-0@lo:101: Request processed in 233us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940516.957434:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788940516.957515:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944780672:0@lo:101: 00010000:00010000:1.0:1788940516.957536:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d042052c00/0x9c34acc08badcf80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcf87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.957548:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d042052c00/0x9c34acc08badcf80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcf87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940516.957626:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944780800:0@lo:256: 00000100:00100000:1.0:1788940516.957672:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940516.957702:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06900 going to sleep for 11 seconds 00000100:00100000:1.0:1788940516.957719:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944780800 00000100:00100000:1.0:1788940516.957723:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944780800 00000100:00100000:1.0:1788940516.957749:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788940516.957756:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:6517:x1875839944780800:12345-0@lo:256: 20000000:01000000:1.0:1788940516.957773:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788940516.957794:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788940516.957798:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788940516.957899:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:6517:x1875839944780800:12345-0@lo:256: Request processed in 142us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940516.957906:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788940516.957938:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944780800:0@lo:256: 10000000:01000000:1.0:1788940516.957986:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788940516.957996:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042052c00/0x9c34acc08badcf80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcf87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.958004:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d042052c00/0x9c34acc08badcf80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcf87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940516.958019:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788940516.958028:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788940516.958031:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788940516.958052:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badcf8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.958060:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badcf8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.958069:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badcf8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940516.958081:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944780928:0@lo:101: 00000100:00100000:1.0:1788940516.958114:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940516.958130:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06900 going to sleep for 11 seconds 00000100:00100000:1.0:1788940516.958147:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944780928 00000100:00100000:1.0:1788940516.958152:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944780928 00000100:00100000:1.0:1788940516.958171:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788940516.958177:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:6517:x1875839944780928:12345-0@lo:101: 00010000:00010000:1.0:1788940516.958185:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940516.958196:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badcf95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcf8e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.958211:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badcf95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcf8e expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.958219:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badcf95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcf8e expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940516.958237:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaabe00, rc 0) 00000100:00100000:1.0:1788940516.958314:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944780928:12345-0@lo:101: Request processed in 135us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940516.958321:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788940516.958399:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944780928:0@lo:101: 00010000:00010000:2.0:1788940516.958428:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badcf8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcf95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940516.958441:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badcf8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcf95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940516.958627:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944781056:0@lo:501: 00000100:00100000:2.0:1788940516.958684:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940516.958722:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d018b2da80 going to sleep for 11 seconds 40000000:02000000:1.0:1788940516.960463:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1788940516.961673:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944781056 00000100:00100000:0.0:1788940516.961689:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944781056 00000100:00100000:0.0:1788940516.961763:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788940516.961775:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944781056:12345-0@lo:501: 00000100:00100000:0.0:1788940516.962037:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944781056:12345-0@lo:501: Request processed in 263us (3350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940516.962067:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788940516.962106:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944781056:0@lo:501: 00000100:00100000:2.0:1788940516.962178:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944781184:0@lo:503: 00000100:00100000:2.0:1788940516.962363:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940516.962424:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d018b2da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940516.962812:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944781184 00000100:00100000:0.0:1788940516.962821:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944781184 00000100:00100000:0.0:1788940516.962876:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788940516.962885:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944781184:12345-0@lo:503: 00000100:00100000:0.0:1788940516.963034:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944781184:12345-0@lo:503: Request processed in 148us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940516.963042:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788940516.963884:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944781184:0@lo:503: 00000100:00100000:1.0:1788940516.967384:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8445:x1875839944779904:12345-0@lo:700: Request processed in 29348us (29421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940516.967406:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788940516.971474:0:8445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06101180 x1875839944779904/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788940532 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940516.971515:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8445:1875839944779904:0@lo:700: 40000000:02000000:2.0:1788940516.971532:0:8445:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:0.0:1788940516.977591:0:8521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8521:1875839944781312:0@lo:502: 00000100:00100000:0.0:1788940516.977704:0:8521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940516.977756:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944781312 00000100:00100000:0.0:1788940516.977764:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944781312 00000100:00100000:0.0:1788940516.977816:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788940516.977841:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:8521:x1875839944781312:12345-0@lo:502: 00000100:00100000:0.0:1788940516.977987:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:8521:x1875839944781312:12345-0@lo:502: Request processed in 161us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940516.977996:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788940516.978076:0:8521:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d024a26d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940516.978103:0:8521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8521:1875839944781312:0@lo:502: 00000020:01000000:0.0:1788940516.978135:0:8521:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788940516.978145:0:8521:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788940516.978154:0:8521:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940516.978157:0:8521:0:(obd_config.c:1662:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788940516.978163:0:8521:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788940516.978166:0:8521:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:0.0:1788940516.978193:0:8521:0:(obd_config.c:2073:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788940516.978204:0:8521:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788940516.978223:0:8521:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91d035608000) 00000020:00000080:0.0:1788940516.978253:0:8521:0:(obd_config.c:786:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1788940516.978284:0:8521:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788940516.978381:0:8521:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788940516.978389:0:8521:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788940516.978397:0:8521:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08badcfa3 00010000:00080000:0.0:1788940516.978432:0:8521:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d02e8d1000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:0.0:1788940516.978745:0:8521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000020:00000004:3.0:1788940516.981313:0:8520:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000001:00100000:1.0:1788940516.981783:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788940516.983005:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8515:x1875839944779776:12345-0@lo:700: Request processed in 45109us (45361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940516.983029:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788940516.983808:0:8515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03588f100 x1875839944779776/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788940532 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940516.983841:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8515:1875839944779776:0@lo:700: 00000020:00000004:3.0:1788940516.984623:0:8520:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:01000000:0.0:1788940516.988504:0:8521:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788940516.988545:0:8521:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788940516.988914:0:8521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940516.989122:0:8521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940516.989217:0:8521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788940516.989328:0:8521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788940516.992461:0:8522:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940516.992473:0:8522:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788940516.993637:0:8521:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788940516.993658:0:8521:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788940516.994343:0:8521:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788940516.994373:0:8521:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08badcfaa 00000100:00080000:1.0:1788940516.994384:0:8521:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788940516.994390:0:8521:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91d02e8d1000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940516.994431:0:8521:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d034758000 x1875839944781440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940516.994464:0:8521:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788940516.994539:0:8521:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940516.994545:0:8521:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940516.994548:0:8521:0:(obd_config.c:1662:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788940516.994552:0:8521:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940516.994557:0:8521:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940516.994559:0:8521:0:(obd_config.c:1662:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788940516.994563:0:8521:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788940516.994565:0:8521:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788940516.994599:0:8521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8521:1875839944781568:0@lo:502: 00000100:00100000:1.0:1788940516.994684:0:8521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940516.994815:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944781440:0@lo:8: 00000100:00100000:0.0:1788940516.994984:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940516.996729:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944781440 00000100:00100000:3.0:1788940516.996747:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944781440 00000100:00100000:3.0:1788940516.996811:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940516.996823:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1875839944781440:12345-0@lo:8: 00000100:00100000:1.0:1788940516.996846:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944781568 00000100:00100000:1.0:1788940516.996860:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944781568 00010000:00080000:3.0:1788940516.996882:0:8439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 272 last 0 00000100:00100000:1.0:1788940516.996924:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000020:00000080:3.0:1788940516.996926:0:8439:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08badcfb1 00000100:00100000:1.0:1788940516.996939:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:8521:x1875839944781568:12345-0@lo:502: 00002000:00100000:3.0:1788940516.996948:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91cf0612c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788940516.996955:0:8439:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788940516.996958:0:8439:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788940516.997090:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1788940516.997108:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:8521:x1875839944781568:12345-0@lo:502: Request processed in 169us (2419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940516.997119:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1788940516.997132:0:8439:0:(import.c:65:import_set_state_nolock()) ffff91cf06129000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940516.997186:0:8521:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d003460480 going to sleep for 11 seconds 00000100:00100000:1.0:1788940516.997213:0:8521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:8521:1875839944781568:0@lo:502: 00000020:01000000:1.0:1788940516.997249:0:8521:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940516.997277:0:8521:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940516.997280:0:8521:0:(obd_config.c:1662:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788940516.997286:0:8521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788940516.997623:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000004:00080000:2.0:1788940516.997626:0:8515:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788940516.997655:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8515:1875839944781824:0@lo:7: 10000000:01000000:0.0:1788940516.997663:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788940516.997678:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badcf8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcf95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940516.997693:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badcf8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcf95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940516.997706:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944781696:0@lo:13: 10000000:01000000:0.0:1788940516.997734:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788940516.997738:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91d00509b3b0 from 1 10000000:01000000:0.0:1788940516.997741:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788940516.997777:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584dc00/0x9c34acc08badcfb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940516.997786:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584dc00/0x9c34acc08badcfb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940516.997797:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584dc00/0x9c34acc08badcfb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940516.997817:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944781952:0@lo:101: 00000100:00100000:3.0:1788940516.998758:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875839944781440:12345-0@lo:8: Request processed in 1931us (3768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940516.998769:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788940516.998893:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d034758000 x1875839944781440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788940526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940516.998925:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788940516.998938:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788940516.998948:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788940516.998955:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788940516.998960:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788940516.998972:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788940516.998980:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944781440:0@lo:8: 00000100:00100000:2.0:1788940517.002945:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940517.003004:0:8515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d018b2da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940517.003095:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940517.003294:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944781824 00000100:00100000:3.0:1788940517.003312:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944781824 00000100:00100000:2.0:1788940517.003420:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940517.003436:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8515:x1875839944781824:12345-0@lo:7: 00000100:00100000:3.0:1788940517.004158:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944782080:0@lo:13: 00000100:00100000:3.0:1788940517.004239:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788940517.004339:0:8523:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788940517.004371:0:8523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8523:1875839944782208:0@lo:7: 00000100:00100000:0.0:1788940517.005004:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944781696 00000100:00100000:0.0:1788940517.005013:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944781696 00000100:00100000:0.0:1788940517.005060:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944782080 00000100:00100000:0.0:1788940517.005064:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944782080 00000100:00100000:0.0:1788940517.005110:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940517.005124:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875839944781696:12345-0@lo:13: 00002000:00000024:0.0:1788940517.005156:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923906560 avail 3692384256 00000100:00100000:0.0:1788940517.005233:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875839944781696:12345-0@lo:13: Request processed in 114us (2137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940517.005243:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940517.005310:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940517.005317:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875839944782080:12345-0@lo:13: 00002000:00000024:0.0:1788940517.005328:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923906560 avail 3692384256 00000100:00100000:0.0:1788940517.005361:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875839944782080:12345-0@lo:13: Request processed in 45us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940517.005380:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940517.005533:0:8523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940517.005562:0:8437:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788940517.005574:0:8437:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788940517.005592:0:8523:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06e5d780 going to sleep for 11 seconds 00010000:00080000:0.0:1788940517.005951:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06102d80 x1875839944782080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940517.005975:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944782080:0@lo:13: 00000100:00100000:0.0:1788940517.006027:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940517.006052:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944781952 00000100:00100000:0.0:1788940517.006057:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944781952 00000100:00100000:0.0:1788940517.006092:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788940517.006100:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944781952:12345-0@lo:101: 00010000:00010000:0.0:1788940517.006114:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940517.006140:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584ce00/0x9c34acc08badcfbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcfb8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940517.006171:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584ce00/0x9c34acc08badcfbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcfb8 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940517.006184:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584ce00/0x9c34acc08badcfbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcfb8 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940517.006195:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584ce00, rc 0) 00000100:00100000:0.0:1788940517.006221:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944781952:12345-0@lo:101: Request processed in 122us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940517.006227:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788940517.006310:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00300ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940517.006322:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944781952:0@lo:101: 00010000:00010000:0.0:1788940517.006341:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584dc00/0x9c34acc08badcfb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcfbf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940517.006365:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584dc00/0x9c34acc08badcfb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcfbf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788940517.007117:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788940517.007174:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03588ce00 x1875839944781696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940517.007198:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944781696:0@lo:13: 00000100:00100000:0.0:1788940517.007371:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944782336:0@lo:501: 00000100:00100000:0.0:1788940517.007954:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940517.007997:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00300ec00 going to sleep for 11 seconds 00000004:00080000:0.0:1788940517.008022:0:8522:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788940517.008133:0:8522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 272340875767ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788940517.008141:0:8522:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788940517.008627:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944782336 00000100:00100000:3.0:1788940517.008638:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944782336 00000100:00100000:3.0:1788940517.008701:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788940517.008712:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944782336:12345-0@lo:501: 00000100:00100000:3.0:1788940517.009002:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944782336:12345-0@lo:501: Request processed in 290us (1047us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788940517.009024:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788940517.009718:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944782336:0@lo:501: 10000000:01000000:0.0:1788940517.009775:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788940517.009786:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584dc00/0x9c34acc08badcfb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcfbf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940517.009799:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584dc00/0x9c34acc08badcfb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcfbf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940517.010615:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944782208 00000100:00100000:3.0:1788940517.010630:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944782208 00000100:00100000:3.0:1788940517.010801:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940517.010813:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8523:x1875839944782208:12345-0@lo:7: 00000004:00080000:2.0:1788940517.017878:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788940517.022163:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788940517.022175:0:8439:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788940517.022327:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8515:x1875839944781824:12345-0@lo:7: Request processed in 18889us (19381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940517.022350:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788940517.022451:0:8515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03588f800 x1875839944781824/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788940533 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940517.022475:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8515:1875839944781824:0@lo:7: 00000004:00080000:2.0:1788940517.022493:0:8515:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788940517.022546:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8515:1875839944782464:0@lo:5: 00000100:00100000:2.0:1788940517.022606:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940517.022645:0:8515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02e8bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940517.022942:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944782464 00000100:00100000:3.0:1788940517.022951:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944782464 00000100:00100000:3.0:1788940517.023006:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940517.023017:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8515:x1875839944782464:12345-0@lo:5: 00002000:00080000:3.0:1788940517.023047:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788940517.023130:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8515:x1875839944782464:12345-0@lo:5: Request processed in 116us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940517.023138:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788940517.023627:0:8515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03588f800 x1875839944782464/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940533 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940517.023640:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8515:1875839944782464:0@lo:5: 00000004:00080000:2.0:1788940517.023649:0:8515:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788940517.023687:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8515:1875839944782592:0@lo:5: 00000100:00100000:2.0:1788940517.024387:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940517.024411:0:8515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02e8bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940517.024854:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944782592 00000100:00100000:3.0:1788940517.024862:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944782592 00000100:00100000:3.0:1788940517.024899:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940517.024908:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8515:x1875839944782592:12345-0@lo:5: 00002000:00080000:3.0:1788940517.024944:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788940517.029387:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8515:x1875839944782592:12345-0@lo:5: Request processed in 4468us (4988us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788940517.029402:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788940517.029860:0:8515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03588f800 x1875839944782592/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940533 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940517.029879:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8515:1875839944782592:0@lo:5: 00000004:00080000:2.0:1788940517.029896:0:8515:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1788940517.029936:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8515:1875839944782720:0@lo:900: 00000100:00100000:2.0:1788940517.029972:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940517.030001:0:8515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02e8bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940517.030818:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944782720 00000100:00100000:3.0:1788940517.030837:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944782720 00000100:00100000:3.0:1788940517.030890:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940517.030899:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8515:x1875839944782720:12345-0@lo:900: 00000100:00100000:3.0:1788940517.030967:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8515:x1875839944782720:12345-0@lo:900: Request processed in 70us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940517.031000:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788940517.031090:0:8515:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03588d880 x1875839944782720/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788940533 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940517.031102:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8515:1875839944782720:0@lo:900: 00002000:00080000:1.0:1788940517.039760:0:8524:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788940517.039778:0:8524:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788940517.040590:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8523:x1875839944782208:12345-0@lo:7: Request processed in 29771us (35048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940517.040610:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788940517.043810:0:8523:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06103b80 x1875839944782208/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788940533 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940517.044370:0:8523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8523:1875839944782208:0@lo:7: 00000004:00080000:0.0:1788940517.044468:0:8523:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788940517.048637:0:8523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8523:1875839944782848:0@lo:5: 00000100:00100000:3.0:1788940517.048709:0:8523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940517.048756:0:8523:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06e5d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788940517.048775:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944782848 00000100:00100000:0.0:1788940517.048793:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944782848 00000100:00100000:0.0:1788940517.048998:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788940517.049013:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8523:x1875839944782848:12345-0@lo:5: 00002000:00080000:0.0:1788940517.049070:0:8439:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788940517.049077:0:8439:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1788940517.071046:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1788940517.071066:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788940517.071075:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788940517.072249:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8523:x1875839944782848:12345-0@lo:5: Request processed in 23227us (23525us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788940517.072284:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788940517.072394:0:8523:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06100380 x1875839944782848/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940533 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940517.072408:0:8523:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788940517.072416:0:8523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8523:1875839944782848:0@lo:5: 00000004:00080000:3.0:1788940517.072433:0:8523:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788940517.072554:0:8523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8523:1875839944782976:0@lo:700: 00000100:00100000:3.0:1788940517.072607:0:8523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940517.072696:0:8523:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06e5d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788940517.076909:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944782976 00000100:00100000:2.0:1788940517.076931:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944782976 00000100:00100000:2.0:1788940517.076992:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940517.077003:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06102a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8523:x1875839944782976:12345-0@lo:700: 00000100:00100000:2.0:1788940517.101085:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06102a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8523:x1875839944782976:12345-0@lo:700: Request processed in 24074us (28467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940517.101105:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788940517.101163:0:8523:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06100380 x1875839944782976/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788940533 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940517.101185:0:8523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8523:1875839944782976:0@lo:700: 00000004:02000040:0.0:1788940517.109882:0:8523:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1788940517.121476:0:8523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8523:1875839944783104:0@lo:5: 00000100:00100000:2.0:1788940517.121553:0:8523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940517.121666:0:8523:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02e8bd600 going to sleep for 11 seconds 00000100:00100000:0.0:1788940517.124031:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944783104 00000100:00100000:0.0:1788940517.124046:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944783104 00000100:00100000:2.0:1788940517.124367:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788940517.124378:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8523:x1875839944783104:12345-0@lo:5: 00002000:00080000:2.0:1788940517.131704:0:8438:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788940517.131727:0:8438:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1788940517.141234:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8523:x1875839944783104:12345-0@lo:5: Request processed in 16851us (19674us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788940517.141247:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788940517.143513:0:8523:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03588d880 x1875839944783104/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940533 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940517.143533:0:8523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8523:1875839944783104:0@lo:5: 00000004:00080000:2.0:1788940517.143548:0:8523:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1788940517.660864:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940518.044488:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940518.044526:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944783232:0@lo:41: 00000100:00100000:1.0:1788940518.044633:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940518.044830:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944783232 00000100:00100000:0.0:1788940518.044841:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944783232 00000100:00100000:0.0:1788940518.044907:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788940518.044918:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944783232:12345-0@lo:41: 00000004:00000024:0.0:1788940518.044964:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788940518.045021:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944783232:12345-0@lo:41: Request processed in 104us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940518.045028:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788940518.045092:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944783232:0@lo:41: 00010000:00010000:0.0:1788940518.684110:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940519.707989:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940520.733175:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940521.636631:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940521.636655:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944783360:0@lo:41: 00000100:00100000:3.0:1788940521.636728:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940521.636804:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944783360 00000100:00100000:3.0:1788940521.636814:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944783360 00000100:00100000:3.0:1788940521.636862:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788940521.636872:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944783360:12345-0@lo:41: 00000004:00000024:3.0:1788940521.636908:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788940521.636983:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944783360:12345-0@lo:41: Request processed in 111us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940521.636991:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788940521.637039:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944783360:0@lo:41: 00010000:00010000:1.0:1788940521.756363:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940522.139446:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940522.139478:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944783488:0@lo:400: 00000100:00100000:1.0:1788940522.139478:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944783616:0@lo:400: 00000100:00100000:3.0:1788940522.139732:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940522.139740:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940522.139795:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944784128:0@lo:400: 00000100:00100000:2.0:1788940522.139802:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944783744:0@lo:400: 00000100:00100000:1.0:1788940522.139834:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940522.139853:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940522.139863:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944784640:0@lo:13: 00000100:00100000:2.0:1788940522.139886:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944784256:0@lo:400: 00000100:00100000:1.0:1788940522.139903:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940522.139920:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940522.139934:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944783872:0@lo:400: 00000100:00100000:1.0:1788940522.139946:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944783616 00000100:00100000:1.0:1788940522.139953:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944783616 00000100:00100000:3.0:1788940522.139960:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940522.139979:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944784384:0@lo:400: 00000100:00100000:1.0:1788940522.139990:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944784128 00000100:00100000:1.0:1788940522.139993:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944784128 00000100:00100000:3.0:1788940522.140000:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940522.140016:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944784256 00000100:00100000:3.0:1788940522.140019:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788940522.140019:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944784256 00000100:00100000:3.0:1788940522.140024:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944784000:0@lo:400: 00000100:00100000:1.0:1788940522.140032:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944783872 00000100:00100000:1.0:1788940522.140034:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944783872 00000100:00100000:3.0:1788940522.140045:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940522.140048:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788940522.140056:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944783616:12345-0@lo:400: 00000100:00100000:3.0:1788940522.140059:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944784512:0@lo:400: 00000100:00100000:3.0:1788940522.140078:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940522.140103:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944783488 00000100:00100000:1.0:1788940522.140106:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944783616:12345-0@lo:400: Request processed in 51us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940522.140107:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944783488 00000100:00100000:1.0:1788940522.140113:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788940522.140130:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788940522.140130:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788940522.140136:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:3645:x1875839944783488:12345-0@lo:400: 00000100:00100000:1.0:1788940522.140148:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944784128:12345-0@lo:400: 00000100:00100000:3.0:1788940522.140168:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:3645:x1875839944783488:12345-0@lo:400: Request processed in 32us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940522.140169:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944784128:12345-0@lo:400: Request processed in 35us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940522.140175:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788940522.140175:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788940522.140186:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788940522.140191:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944784256:12345-0@lo:400: 00000100:00080000:3.0:1788940522.140201:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788940522.140205:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940522.140214:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944784256:12345-0@lo:400: Request processed in 24us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940522.140216:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944784384 00000100:00100000:3.0:1788940522.140218:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944784384 00000100:00100000:1.0:1788940522.140230:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788940522.140242:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788940522.140247:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944784512 00000100:00100000:1.0:1788940522.140247:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944783872:12345-0@lo:400: 00000100:00100000:3.0:1788940522.140249:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944784512 00000100:00100000:1.0:1788940522.140303:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944783872:12345-0@lo:400: Request processed in 55us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940522.140310:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788940522.140340:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944784640 00000100:00100000:1.0:1788940522.140344:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944784640 00000100:00100000:1.0:1788940522.140373:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940522.140380:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034759880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875839944784640:12345-0@lo:13: 00002000:00000024:1.0:1788940522.140403:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940522.140438:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034759880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875839944784640:12345-0@lo:13: Request processed in 58us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940522.140444:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788940522.140489:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03588ca80 x1875839944784128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940522.140505:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944784128:0@lo:400: 00010000:00080000:1.0:1788940522.140516:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06f39c00 x1875839944784640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940522.140524:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788940522.140542:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944784640:0@lo:13: 00000100:00100000:3.0:1788940522.140551:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788940522.140553:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03588ce00 x1875839944783616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940522.140557:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944784384:12345-0@lo:400: 00000100:00100000:1.0:1788940522.140562:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944783616:0@lo:400: 00000100:00100000:3.0:1788940522.140675:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944784384:12345-0@lo:400: Request processed in 117us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940522.140687:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940522.140701:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940522.140706:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875839944784512:12345-0@lo:400: 00000100:00100000:3.0:1788940522.140735:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875839944784512:12345-0@lo:400: Request processed in 29us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940522.140739:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940522.140757:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944783744 00010000:00080000:2.0:1788940522.140757:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03588ea00 x1875839944784256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940522.140762:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944783744 00000100:00100000:2.0:1788940522.140772:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944784256:0@lo:400: 00000100:00100000:3.0:1788940522.140940:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944784000 00000100:00100000:3.0:1788940522.140944:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944784000 00000100:00100000:2.0:1788940522.141072:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788940522.141083:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944783744:12345-0@lo:400: 00000100:00100000:2.0:1788940522.141133:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944783744:12345-0@lo:400: Request processed in 54us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940522.141139:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788940522.141156:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788940522.141171:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944784000:12345-0@lo:400: 00000100:00100000:2.0:1788940522.141205:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944784000:12345-0@lo:400: Request processed in 34us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940522.141212:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788940522.141218:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940522.141250:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944784000:0@lo:400: 00000100:00100000:2.0:1788940522.141295:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940522.141305:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944784768:0@lo:13: 00000100:00100000:2.0:1788940522.141332:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940522.141362:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944784768 00000100:00100000:2.0:1788940522.141365:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944784768 00000100:00100000:2.0:1788940522.141388:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940522.141395:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875839944784768:12345-0@lo:13: 00002000:00000024:2.0:1788940522.141406:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1788940522.141416:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06f38700 x1875839944784512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940522.141427:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944784512:0@lo:400: 00010000:00080000:3.0:1788940522.141438:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03588c000 x1875839944783872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940522.141445:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944783872:0@lo:400: 00010000:00080000:3.0:1788940522.141452:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06f3b100 x1875839944784384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940522.141459:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944784384:0@lo:400: 00000100:00100000:3.0:1788940522.141466:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944783488:0@lo:400: 00000100:00100000:2.0:1788940522.141841:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875839944784768:12345-0@lo:13: Request processed in 445us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940522.141847:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788940522.141875:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06f3b480 x1875839944784768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940522.141889:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944784768:0@lo:13: 00000100:00100000:1.0:1788940522.142158:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944783744:0@lo:400: 00000001:00080000:1.0:1788940522.665984:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1788940522.779451:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940523.165389:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944784896:0@lo:41: 00000100:00100000:0.0:1788940523.165459:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940523.165532:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944784896 00000100:00100000:0.0:1788940523.165540:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944784896 00000100:00100000:0.0:1788940523.165583:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788940523.165591:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944784896:12345-0@lo:41: 00000004:00000024:0.0:1788940523.165624:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788940523.165672:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944784896:12345-0@lo:41: Request processed in 81us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940523.165679:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788940523.165735:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944784896:0@lo:41: 00000001:02000400:2.0:1788940523.421759:0:8814:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788940523.804835:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788940524.681129:0:8866:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788940524.681732:0:8866:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788940524.828724:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940525.851603:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940526.749781:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944785024:0@lo:41: 00000100:00100000:2.0:1788940526.749855:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940526.751425:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944785024 00000100:00100000:1.0:1788940526.751437:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944785024 00000100:00100000:1.0:1788940526.751499:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788940526.751509:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944785024:12345-0@lo:41: 00000004:00000024:1.0:1788940526.751545:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788940526.751662:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944785024:12345-0@lo:41: Request processed in 154us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940526.751670:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788940526.754923:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944785024:0@lo:41: 00010000:00010000:0.0:1788940526.877489:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940527.260620:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944785152:0@lo:13: 00000100:00100000:0.0:1788940527.260677:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940527.260748:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944785152 00000100:00100000:0.0:1788940527.260757:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944785152 00000100:00100000:0.0:1788940527.260823:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940527.260833:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944785152:12345-0@lo:13: 00002000:00000024:0.0:1788940527.260872:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940527.260920:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944785152:12345-0@lo:13: Request processed in 89us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940527.260927:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788940527.260963:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788940527.260994:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06108e00 x1875839944785152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940527.261013:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944785152:0@lo:13: 00000100:00100000:3.0:1788940527.261422:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944785408:0@lo:400: 00000100:00100000:0.0:1788940527.261423:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944785280:0@lo:13: 00000100:00100000:0.0:1788940527.261585:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940527.263657:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944785664:0@lo:400: 00000100:00100000:3.0:1788940527.263805:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940527.263862:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944785920:0@lo:400: 00000100:00100000:3.0:1788940527.263908:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940527.264180:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788940527.264189:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944785536:0@lo:400: 00000100:00100000:3.0:1788940527.264406:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940527.264427:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944786048:0@lo:400: 00000100:00100000:3.0:1788940527.264447:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940527.264483:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944785920 00000100:00100000:3.0:1788940527.264493:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944785920 00000100:00100000:3.0:1788940527.264549:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944785536 00000100:00100000:3.0:1788940527.264552:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944785536 00000100:00100000:3.0:1788940527.264564:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944786048 00000100:00100000:3.0:1788940527.264566:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944786048 00000100:00100000:3.0:1788940527.264584:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788940527.264592:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944785920:12345-0@lo:400: 00000100:00100000:3.0:1788940527.264645:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944785920:12345-0@lo:400: Request processed in 53us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940527.264653:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788940527.264670:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940527.264677:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944785536:12345-0@lo:400: 00000100:00100000:3.0:1788940527.264704:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944785536:12345-0@lo:400: Request processed in 28us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940527.264720:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940527.264745:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788940527.264752:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944786048:12345-0@lo:400: 00000100:00100000:3.0:1788940527.264780:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944786048:12345-0@lo:400: Request processed in 29us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940527.264785:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788940527.264830:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06103480 x1875839944785536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940527.264845:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944785536:0@lo:400: 00010000:00080000:3.0:1788940527.264857:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06101c00 x1875839944786048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940527.264866:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944786048:0@lo:400: 00010000:00080000:3.0:1788940527.264877:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06103100 x1875839944785920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940527.264885:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944785920:0@lo:400: 00000100:00080000:3.0:1788940527.266772:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788940527.266784:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940527.267348:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06102680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944785792:0@lo:400: 00000100:00100000:0.0:1788940527.267400:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940527.267740:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944785792 00000100:00100000:0.0:1788940527.267749:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944785792 00000100:00100000:0.0:1788940527.267796:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788940527.267805:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944785792:12345-0@lo:400: 00000100:00100000:0.0:1788940527.267867:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944785792:12345-0@lo:400: Request processed in 63us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940527.267875:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788940527.267927:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944785280 00000100:00100000:0.0:1788940527.267932:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944785280 00000100:00100000:0.0:1788940527.267977:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788940527.267985:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944785280:12345-0@lo:13: 00002000:00000024:0.0:1788940527.268002:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940527.268035:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944785280:12345-0@lo:13: Request processed in 51us (6450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940527.268041:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788940527.268061:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788940527.268090:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06102d80 x1875839944785280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940527.268101:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788940527.268123:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944785280:0@lo:13: 00000100:00100000:0.0:1788940527.268136:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06102680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944785792:0@lo:400: 00000100:00100000:0.0:1788940527.269701:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944785408 00000100:00100000:0.0:1788940527.269717:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944785408 00000100:00100000:0.0:1788940527.269774:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788940527.269782:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:3645:x1875839944785408:12345-0@lo:400: 00000100:00100000:0.0:1788940527.269851:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:3645:x1875839944785408:12345-0@lo:400: Request processed in 71us (6047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940527.269858:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788940527.269910:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944785408:0@lo:400: 00000100:00100000:1.0:1788940527.271028:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940527.271316:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944786176:0@lo:400: 00000100:00100000:1.0:1788940527.271360:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940527.271778:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944785664 00000100:00100000:0.0:1788940527.271786:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944785664 00000100:00100000:0.0:1788940527.271827:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788940527.271835:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944785664:12345-0@lo:400: 00000100:00100000:0.0:1788940527.271888:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944785664:12345-0@lo:400: Request processed in 54us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940527.271894:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788940527.272076:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944786176 00000100:00100000:1.0:1788940527.272081:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944786176 00000100:00100000:1.0:1788940527.272220:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940527.272229:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944786176:12345-0@lo:400: 00000100:00100000:1.0:1788940527.274754:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944786176:12345-0@lo:400: Request processed in 2517us (3382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940527.274768:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788940527.275854:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06100700 x1875839944785664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940527.275874:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944785664:0@lo:400: 00010000:00080000:1.0:1788940527.275886:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d0042b1180 x1875839944786176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940527.275903:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944786176:0@lo:400: 00000020:00000004:3.0:1788940527.379857:0:8967:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788940527.380108:0:8967:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788940527.903994:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940528.292948:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944786304:0@lo:41: 00000100:00100000:0.0:1788940528.293054:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940528.300323:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944786304 00000100:00100000:1.0:1788940528.300349:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944786304 00000100:00100000:1.0:1788940528.300445:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788940528.300458:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944786304:12345-0@lo:41: 00000004:00000024:1.0:1788940528.300528:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788940528.317032:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944786304:12345-0@lo:41: Request processed in 16553us (23954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940528.317054:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788940528.317707:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944786304:0@lo:41: 00000020:00000004:1.0:1788940528.359131:0:9015:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788940528.359148:0:9015:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788940528.923669:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940529.950922:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940530.972121:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940531.871376:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940531.871405:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944786432:0@lo:41: 00000100:00100000:3.0:1788940531.871491:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940531.871578:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944786432 00000100:00100000:3.0:1788940531.871601:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944786432 00000100:00100000:3.0:1788940531.871654:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788940531.871664:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944786432:12345-0@lo:41: 00000004:00000024:3.0:1788940531.871716:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788940531.871766:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944786432:12345-0@lo:41: Request processed in 103us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940531.871773:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788940531.871838:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944786432:0@lo:41: 00010000:00010000:3.0:1788940531.999438:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940532.385324:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944786944:0@lo:400: 00000100:00100000:2.0:1788940532.385422:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940532.385485:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944787456:0@lo:400: 00000100:00100000:2.0:1788940532.385510:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940532.385563:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788940532.385570:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944786560:0@lo:400: 00000100:00100000:2.0:1788940532.385600:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940532.385622:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944787072:0@lo:400: 00000100:00100000:2.0:1788940532.385647:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940532.385676:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944786688:0@lo:400: 00000100:00100000:2.0:1788940532.385712:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940532.385730:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944787200:0@lo:400: 00000100:00100000:2.0:1788940532.385750:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940532.385769:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788940532.385774:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944786816:0@lo:400: 00000100:00100000:2.0:1788940532.385796:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940532.385812:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944787328:0@lo:400: 00000100:00100000:2.0:1788940532.385849:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940532.385892:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944787072 00000100:00100000:2.0:1788940532.385902:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944787072 00000100:00100000:2.0:1788940532.385960:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944786688 00000100:00100000:2.0:1788940532.385964:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944786688 00000100:00100000:2.0:1788940532.385977:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944787200 00000100:00100000:2.0:1788940532.385980:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944787200 00000100:00100000:2.0:1788940532.385993:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944786816 00000100:00100000:2.0:1788940532.385995:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944786816 00000100:00100000:2.0:1788940532.386010:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940532.386020:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944787072:12345-0@lo:400: 00000100:00100000:2.0:1788940532.386083:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944787072:12345-0@lo:400: Request processed in 64us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940532.386091:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940532.386110:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788940532.386122:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944786688:12345-0@lo:400: 00000100:00100000:2.0:1788940532.386169:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944786688:12345-0@lo:400: Request processed in 48us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940532.386175:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788940532.386187:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788940532.386192:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944787200:12345-0@lo:400: 00000100:00100000:2.0:1788940532.386218:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944787200:12345-0@lo:400: Request processed in 26us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940532.386223:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788940532.386233:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788940532.386239:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944786816:12345-0@lo:400: 00000100:00100000:2.0:1788940532.386296:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944786816:12345-0@lo:400: Request processed in 57us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940532.386301:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788940532.386322:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944787456 00000100:00100000:2.0:1788940532.386326:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944787456 00000100:00100000:2.0:1788940532.386351:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944787328 00000100:00100000:2.0:1788940532.386354:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944787328 00000100:00100000:2.0:1788940532.386370:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940532.386376:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944787456:12345-0@lo:400: 00000100:00100000:2.0:1788940532.386406:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944787456:12345-0@lo:400: Request processed in 30us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940532.386412:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940532.386424:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940532.386429:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944787328:12345-0@lo:400: 00000100:00100000:2.0:1788940532.386452:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944787328:12345-0@lo:400: Request processed in 23us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940532.386464:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788940532.386492:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940532.386497:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940532.386499:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788940532.386532:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06f39500 x1875839944786816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940532.386548:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944786816:0@lo:400: 00010000:00080000:2.0:1788940532.386558:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06f38a80 x1875839944787328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940532.386566:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944787328:0@lo:400: 00010000:00080000:2.0:1788940532.386574:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06f3bb80 x1875839944786688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940532.386581:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944786688:0@lo:400: 00010000:00080000:2.0:1788940532.386589:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06f3aa00 x1875839944787200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940532.386597:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944787200:0@lo:400: 00010000:00080000:2.0:1788940532.386630:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06f3b800 x1875839944787072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940532.386637:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944787072:0@lo:400: 00010000:00080000:2.0:1788940532.386645:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06f38e00 x1875839944787456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940532.386652:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944787456:0@lo:400: 00000100:00100000:1.0:1788940532.386769:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944786944 00000100:00100000:1.0:1788940532.386774:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944786944 00000100:00100000:1.0:1788940532.386815:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788940532.386823:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944786944:12345-0@lo:400: 00000100:00100000:1.0:1788940532.386869:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944786944:12345-0@lo:400: Request processed in 46us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940532.386875:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788940532.386907:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944786944:0@lo:400: 00000100:00100000:2.0:1788940532.389453:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944786560 00000100:00100000:2.0:1788940532.389496:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944786560 00000100:00100000:2.0:1788940532.389580:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788940532.389593:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:3645:x1875839944786560:12345-0@lo:400: 00000100:00100000:2.0:1788940532.389715:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:3645:x1875839944786560:12345-0@lo:400: Request processed in 125us (4113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940532.389723:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788940532.389848:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944786560:0@lo:400: 00000100:00100000:1.0:1788940532.392833:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944787584:0@lo:13: 00000100:00100000:1.0:1788940532.392926:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940532.392994:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944787584 00000100:00100000:1.0:1788940532.393003:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944787584 00000100:00100000:1.0:1788940532.393073:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940532.393082:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944787584:12345-0@lo:13: 00002000:00000024:1.0:1788940532.393119:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940532.393166:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944787584:12345-0@lo:13: Request processed in 85us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940532.393174:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788940532.393222:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d0042b1180 x1875839944787584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940532.393244:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944787584:0@lo:13: 00000100:00100000:0.0:1788940532.396011:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944787712:0@lo:13: 00000100:00100000:0.0:1788940532.396109:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940532.400472:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944787712 00000100:00100000:2.0:1788940532.400496:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944787712 00000100:00100000:2.0:1788940532.400584:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788940532.400598:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944787712:12345-0@lo:13: 00002000:00000024:2.0:1788940532.400636:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940532.401466:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944787712:12345-0@lo:13: Request processed in 867us (5351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940532.401477:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788940532.406096:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d0359fb800 x1875839944787712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940532.406133:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944787712:0@lo:13: 00010000:00010000:1.0:1788940533.029146:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940533.404155:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944787840:0@lo:41: 00000100:00100000:2.0:1788940533.404227:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940533.405139:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944787840 00000100:00100000:1.0:1788940533.405151:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944787840 00000100:00100000:1.0:1788940533.405210:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788940533.405220:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944787840:12345-0@lo:41: 00000004:00000024:1.0:1788940533.405288:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788940533.405342:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944787840:12345-0@lo:41: Request processed in 124us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940533.405349:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788940533.405502:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944787840:0@lo:41: 00010000:00010000:3.0:1788940534.048719:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940535.067744:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940536.092288:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940536.989638:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944787968:0@lo:41: 00000100:00100000:3.0:1788940536.989731:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940536.989815:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944787968 00000100:00100000:3.0:1788940536.989823:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944787968 00000100:00100000:3.0:1788940536.989868:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788940536.989878:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944787968:12345-0@lo:41: 00000004:00000024:3.0:1788940536.989921:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788940536.989973:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944787968:12345-0@lo:41: Request processed in 95us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940536.989979:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788940536.990032:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944787968:0@lo:41: 00010000:00010000:1.0:1788940537.115447:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940537.500104:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940537.500137:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944788096:0@lo:13: 00000100:00100000:1.0:1788940537.500208:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940537.500293:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944788096 00000100:00100000:1.0:1788940537.500302:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944788096 00000100:00100000:1.0:1788940537.500361:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940537.500370:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944788096:12345-0@lo:13: 00002000:00000024:1.0:1788940537.500409:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940537.500461:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944788096:12345-0@lo:13: Request processed in 92us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940537.500468:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788940537.500492:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940537.500927:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03588c380 x1875839944788096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940537.500948:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944788096:0@lo:13: 00000100:00100000:0.0:1788940537.501407:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944788352:0@lo:400: 00000100:00100000:0.0:1788940537.501453:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940537.501477:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944788864:0@lo:400: 00000100:00100000:0.0:1788940537.501494:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940537.501512:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788940537.501517:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944788224:0@lo:400: 00000100:00100000:0.0:1788940537.501551:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940537.501572:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944788736:0@lo:400: 00000100:00100000:0.0:1788940537.501595:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940537.501617:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944788608:0@lo:400: 00000100:00100000:1.0:1788940537.501875:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944788480:0@lo:400: 00000100:00100000:1.0:1788940537.502009:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940537.503820:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944788992:0@lo:400: 00000100:00100000:3.0:1788940537.504037:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944788352 00000100:00100000:3.0:1788940537.504057:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944788352 00000100:00100000:3.0:1788940537.504100:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944788864 00000100:00100000:3.0:1788940537.504103:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944788864 00000100:00100000:3.0:1788940537.504136:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944788736 00000100:00100000:3.0:1788940537.504140:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944788736 00000100:00100000:3.0:1788940537.504152:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944788480 00000100:00100000:3.0:1788940537.504154:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944788480 00000100:00100000:3.0:1788940537.504169:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788940537.504178:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944788352:12345-0@lo:400: 00000100:00100000:1.0:1788940537.504463:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940537.506079:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940537.506155:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944789120:0@lo:13: 00000100:00100000:0.0:1788940537.506211:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940537.506292:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788940537.506305:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944788864:12345-0@lo:400: 00000100:00100000:0.0:1788940537.506363:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944788864:12345-0@lo:400: Request processed in 63us (4868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940537.506371:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788940537.506395:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788940537.506402:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944788736:12345-0@lo:400: 00000100:00100000:0.0:1788940537.506433:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944788736:12345-0@lo:400: Request processed in 32us (4836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940537.506438:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788940537.506449:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788940537.506456:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944788480:12345-0@lo:400: 00000100:00100000:0.0:1788940537.506484:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944788480:12345-0@lo:400: Request processed in 29us (4476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940537.506489:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788940537.506512:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944788224 00000100:00100000:0.0:1788940537.506519:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944788224 00000100:00100000:0.0:1788940537.506556:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788940537.506563:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:3648:x1875839944788224:12345-0@lo:400: 00000100:00100000:0.0:1788940537.506601:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:3648:x1875839944788224:12345-0@lo:400: Request processed in 38us (5049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940537.506607:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788940537.506651:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944788608 00000100:00100000:0.0:1788940537.506655:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944788608 00000100:00100000:0.0:1788940537.506682:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788940537.506689:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944788608:12345-0@lo:400: 00000100:00100000:0.0:1788940537.506724:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944788608:12345-0@lo:400: Request processed in 35us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940537.506730:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788940537.506767:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944788224:0@lo:400: 00010000:00080000:0.0:1788940537.506783:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03475ca80 x1875839944788736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940537.506927:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944788736:0@lo:400: 00010000:00080000:0.0:1788940537.506945:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d020c8ea00 x1875839944788864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940537.506955:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944788864:0@lo:400: 00000100:00100000:0.0:1788940537.506989:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944788608:0@lo:400: 00000100:00100000:3.0:1788940537.507965:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944788352:12345-0@lo:400: Request processed in 3783us (6505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940537.507977:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788940537.508119:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944788992 00000100:00100000:3.0:1788940537.508127:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944788992 00000100:00100000:3.0:1788940537.508167:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940537.508175:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944788992:12345-0@lo:400: 00000100:00100000:3.0:1788940537.508221:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944788992:12345-0@lo:400: Request processed in 47us (3924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940537.508227:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788940537.508243:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940537.508248:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940537.508250:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788940537.508436:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d020c8ed80 x1875839944788992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940537.508448:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944788992:0@lo:400: 00010000:00080000:1.0:1788940537.508472:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf0610b100 x1875839944788480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940537.508481:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944788480:0@lo:400: 00010000:00080000:0.0:1788940537.508482:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06108700 x1875839944788352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940537.508491:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944788352:0@lo:400: 00000100:00100000:1.0:1788940537.508558:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944789120 00000100:00100000:1.0:1788940537.508564:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944789120 00000100:00100000:1.0:1788940537.508591:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940537.508598:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944789120:12345-0@lo:13: 00002000:00000024:1.0:1788940537.508614:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940537.508668:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944789120:12345-0@lo:13: Request processed in 69us (2455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940537.508673:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788940537.509372:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03588c380 x1875839944789120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940537.509392:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944789120:0@lo:13: 00010000:00010000:2.0:1788940538.152030:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940538.534416:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944789248:0@lo:41: 00000100:00100000:3.0:1788940538.534499:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940538.542924:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944789248 00000100:00100000:0.0:1788940538.542940:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944789248 00000100:00100000:0.0:1788940538.543001:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788940538.543011:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944789248:12345-0@lo:41: 00000004:00000024:0.0:1788940538.543050:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788940538.543162:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944789248:12345-0@lo:41: Request processed in 152us (8663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940538.543169:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788940538.544555:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944789248:0@lo:41: 00010000:00010000:1.0:1788940539.163646:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940540.200652:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940541.216200:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788940542.059103:0:9515:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788940542.059108:0:9515:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788940542.059109:0:9515:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788940542.059550:0:9515:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91d037817800 00000020:01000004:0.0:1788940542.059567:0:9515:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788940542.059582:0:9515:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788940542.059607:0:9515:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91d03560cd88) 00000020:00000080:0.0:1788940542.059627:0:9515:0:(obd_config.c:786:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00000100:00100000:0.0:1788940542.108487:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940542.108511:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944789376:0@lo:41: 00000100:00100000:0.0:1788940542.108606:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940542.108792:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944789376 00000100:00100000:0.0:1788940542.108799:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944789376 00000100:00100000:0.0:1788940542.108844:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788940542.108853:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944789376:12345-0@lo:41: 00000004:00000024:0.0:1788940542.108885:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788940542.108928:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944789376:12345-0@lo:41: Request processed in 75us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940542.108935:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788940542.109005:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944789376:0@lo:41: 00100000:10000000:0.0:1788940542.125903:0:9515:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788940542.125965:0:9515:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1788940542.224741:0:9515:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788940542.224975:0:9515:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788940542.224989:0:9515:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788940542.225000:0:9515:0:(genops.c:1393:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9c34acc08badcfcd 00000020:01000004:1.0:1788940542.225007:0:9515:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788940542.225029:0:9515:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.125@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788940542.225032:0:9515:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788940542.225038:0:9515:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788940542.225069:0:9515:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788940542.225073:0:9515:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:0.0:1788940542.243245:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788940542.267824:0:9515:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788940542.267860:0:9515:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.125@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788940542.267865:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788940542.267866:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788940542.267867:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940542.267869:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940542.267874:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940542.267875:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940542.267877:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788940542.267878:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788940542.267879:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788940542.267881:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940542.267882:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788940542.267886:0:9515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788940542.267888:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788940542.267889:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788940542.267890:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940542.267891:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940542.267892:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940542.267893:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940542.267894:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788940542.267895:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788940542.267896:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788940542.267896:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940542.267897:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788940542.267927:0:9515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788940542.267948:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944789504:0@lo:253: 00000100:00100000:3.0:1788940542.268249:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940542.268756:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0358959c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940542.269715:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944789504 00000100:00100000:1.0:1788940542.269726:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944789504 00000100:00100000:1.0:1788940542.269815:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788940542.269827:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:9515:x1875839944789504:12345-0@lo:253: 20000000:01000000:1.0:1788940542.269865:0:6512:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788940542.269869:0:6512:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788940542.269874:0:6512:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788940542.269877:0:6512:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788940542.270508:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940542.270742:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1788940542.270757:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788940542.270775:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1788940542.270782:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788940542.270795:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1788940542.270812:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1788940542.270918:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1788940542.270934:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.125@tcp 20000000:01000000:1.0:1788940542.270935:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:1.0:1788940542.270950:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1788940542.270963:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788940542.270979:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1788940542.271051:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:1.0:1788940542.271070:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1788940542.271077:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788940542.271088:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1788940542.271100:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1788940542.271243:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1788940542.271727:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.125@tcp 20000000:01000000:1.0:1788940542.271730:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:1.0:1788940542.271753:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1788940542.271760:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788940542.271774:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1788940542.271779:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:1.0:1788940542.271790:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1788940542.271795:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788940542.271806:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1788940542.271819:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1788940542.272561:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1788940542.272577:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.125@tcp 20000000:01000000:1.0:1788940542.272579:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.125@tcp (null) (null) (null) 00000040:00080000:1.0:1788940542.272627:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1788940542.272635:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788940542.272719:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1788940542.272728:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.125@tcp (null) (null) 00000040:00080000:1.0:1788940542.272745:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1788940542.272752:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788940542.272787:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1788940542.272805:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1788940542.272818:0:6512:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788940542.272843:0:6512:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788940542.272847:0:6512:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788940542.272916:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788940542.272919:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788940542.273756:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1788940542.273796:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1788940542.273809:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788940542.274828:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788940542.274851:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1788940542.274865:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1788940542.274874:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788940542.274876:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788940542.275756:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1788940542.275786:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1788940542.275801:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1788940542.275982:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1788940542.276072:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1788940542.276088:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1788940542.276097:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788940542.276099:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788940542.276611:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1788940542.276630:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1788940542.276656:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1788940542.276898:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1788940542.276918:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1788940542.276933:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1788940542.276942:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788940542.276944:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788940542.277915:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1788940542.278220:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1788940542.278247:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1788940542.278462:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1788940542.278477:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788940542.278480:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788940542.278942:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1788940542.278963:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1788940542.278979:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1788940542.279454:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1788940542.279477:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1788940542.279508:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:1.0:1788940542.279525:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788940542.279543:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badcfd4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.279561:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d02eaaac00/0x9c34acc08badceca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcec3 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.279579:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d02eaab000/0x9c34acc08badcef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badceed expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.279586:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584cc00/0x9c34acc08badcf33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcf2c expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.279602:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d02eaab200/0x9c34acc08badcf4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcf48 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.279609:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584d200/0x9c34acc08badcf79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcf72 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.279616:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badcf95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcf8e expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.279622:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584ce00/0x9c34acc08badcfbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcfb8 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.279631:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badcfd4 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.279738:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584ce00/0x9c34acc08badcfbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badcfb8 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.279754:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584ce00/0x9c34acc08badcfbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badcfb8 expref: 21 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940542.279770:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875839944789632:0@lo:104: 00000100:00100000:1.0:1788940542.279836:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940542.279931:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badcf95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badcf8e expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.279940:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badcf95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badcf8e expref: 21 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940542.279948:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875839944789760:0@lo:104: 00000100:00100000:1.0:1788940542.279970:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940542.280109:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584d200/0x9c34acc08badcf79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badcf72 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.280117:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584d200/0x9c34acc08badcf79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badcf72 expref: 21 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940542.280125:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875839944789888:0@lo:104: 00000100:00100000:1.0:1788940542.280145:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940542.280212:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944789632 00000100:00100000:3.0:1788940542.280220:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944789632 00000100:00100000:3.0:1788940542.280285:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944789760 00000100:00100000:3.0:1788940542.280288:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944789760 00000100:00100000:3.0:1788940542.280303:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788940542.280322:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:6512:x1875839944789632:12345-0@lo:104: 00010000:00010000:3.0:1788940542.280334:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d03584dc00/0x9c34acc08badcfb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcfbf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.280389:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940542.280395:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:6512:x1875839944789632:12345-0@lo:104: Request processed in 86us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940542.280402:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788940542.280420:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788940542.280426:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:6512:x1875839944789760:12345-0@lo:104: 00010000:00010000:3.0:1788940542.280433:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badcf8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcf95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.280464:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788940542.280469:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:6512:x1875839944789760:12345-0@lo:104: Request processed in 44us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940542.280474:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1788940542.280663:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940542.280670:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584dc00/0x9c34acc08badcfb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcfbf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.280677:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584dc00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940542.280682:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584dc00/0x9c34acc08badcfb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcfbf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.280690:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584dc00/0x9c34acc08badcfb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcfbf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940542.280709:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584dc00/0x9c34acc08badcfb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcfbf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940542.280714:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940542.280750:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584dc00/0x9c34acc08badcfb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcfbf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.280757:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940542.280777:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584dc00/0x9c34acc08badcfb8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcfbf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.280784:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584dc00/0x9c34acc08badcfb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcfbf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.280795:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940542.280799:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badcf8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcf95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.280805:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaab800 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940542.280808:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badcf8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcf95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.280815:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badcf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcf95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940542.280821:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badcf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcf95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940542.280825:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940542.280845:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badcf8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcf95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.280851:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940542.280857:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badcf8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcf95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.280863:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badcf8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcf95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.280871:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940542.280873:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940542.280875:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940542.280888:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944790144:0@lo:103: 00000100:00100000:2.0:1788940542.280919:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940542.280951:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940542.280957:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944790016:0@lo:103: 00000100:00100000:2.0:1788940542.280977:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940542.281017:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944790144 00000100:00100000:2.0:1788940542.281021:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944790144 00010000:00010000:2.0:1788940542.281041:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badcf95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcf8e expref: 22 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940542.281064:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944790016 00000100:00100000:2.0:1788940542.281067:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944790016 00010000:00010000:2.0:1788940542.281079:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584ce00/0x9c34acc08badcfbf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcfb8 expref: 23 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940542.281098:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788940542.281105:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:3646:x1875839944790144:12345-0@lo:103: 00010000:00010000:2.0:1788940542.281124:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940542.281129:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badcf95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcf8e expref: 23 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.281138:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badcf95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badcf8e expref: 23 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.281672:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940542.281710:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:3646:x1875839944790144:12345-0@lo:103: Request processed in 605us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940542.281718:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788940542.281739:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940542.281745:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:3646:x1875839944790016:12345-0@lo:103: 00010000:00010000:2.0:1788940542.281753:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940542.281757:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584ce00/0x9c34acc08badcfbf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcfb8 expref: 22 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.281767:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584ce00/0x9c34acc08badcfbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badcfb8 expref: 22 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.281776:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940542.281797:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:3646:x1875839944790016:12345-0@lo:103: Request processed in 53us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940542.281802:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940542.281849:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944790016:0@lo:103: 00000100:00100000:2.0:1788940542.281859:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944790144:0@lo:103: 00010000:00010000:1.0:1788940542.282220:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d02eaab200/0x9c34acc08badcf4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badcf48 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.282231:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d02eaab200/0x9c34acc08badcf4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badcf48 expref: 21 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940542.282242:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ebb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875839944790272:0@lo:104: 00000100:00100000:1.0:1788940542.282296:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940542.282379:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584cc00/0x9c34acc08badcf33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badcf2c expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.282388:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584cc00/0x9c34acc08badcf33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badcf2c expref: 21 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940542.282396:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875839944790400:0@lo:104: 00000100:00100000:1.0:1788940542.282425:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940542.282443:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d02eaab000/0x9c34acc08badcef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badceed expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.282451:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d02eaab000/0x9c34acc08badcef4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badceed expref: 21 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940542.282459:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875839944790528:0@lo:104: 00000100:00100000:1.0:1788940542.282481:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940542.282497:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d02eaaac00/0x9c34acc08badceca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badcec3 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.282503:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d02eaaac00/0x9c34acc08badceca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badcec3 expref: 21 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940542.282511:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875839944790656:0@lo:104: 00000100:00100000:1.0:1788940542.282526:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021ad9900 going to sleep for 11 seconds 00010000:00010000:1.0:1788940542.282540:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584ce00/0x9c34acc08badcfbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badcfb8 expref: 21 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940542.282551:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875839944789632:0@lo:104: 00010000:00010000:1.0:1788940542.282560:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badcf95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badcf8e expref: 20 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940542.282567:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875839944789760:0@lo:104: 00000100:00100000:3.0:1788940542.282720:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788940542.282740:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940542.282751:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944789888 00000100:00100000:3.0:1788940542.282756:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944789888 00000100:00100000:3.0:1788940542.282784:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944790272 00000100:00100000:3.0:1788940542.282787:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944790272 00000100:00100000:3.0:1788940542.282796:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944790400 00000100:00100000:3.0:1788940542.282799:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944790400 00000100:00100000:3.0:1788940542.282819:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944790528 00000100:00100000:3.0:1788940542.282822:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944790528 00000100:00100000:3.0:1788940542.282831:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944790656 00000100:00100000:3.0:1788940542.282833:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944790656 00000100:00100000:3.0:1788940542.282846:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788940542.282852:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+7:6512:x1875839944789888:12345-0@lo:104: 00010000:00010000:3.0:1788940542.282864:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badcf72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcf79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.282915:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940542.282920:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+7:6512:x1875839944789888:12345-0@lo:104: Request processed in 69us (2774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940542.282926:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788940542.282941:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788940542.282946:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+6:6512:x1875839944790272:12345-0@lo:104: 00010000:00010000:3.0:1788940542.282954:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d02eaaaa00/0x9c34acc08badcf48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcf4f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.282981:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788940542.283074:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875839944789888:0@lo:104: 00000100:00100000:1.0:1788940542.283082:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ebb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875839944790272:0@lo:104: 00010000:00010000:2.0:1788940542.283132:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940542.283139:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badcf72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcf79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.283221:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaabc00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940542.283225:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badcf72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcf79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.283235:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badcf72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcf79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940542.283242:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badcf72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcf79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940542.283247:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940542.283298:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badcf72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcf79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.283305:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788940542.283443:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+6:6512:x1875839944790272:12345-0@lo:104: Request processed in 40us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940542.283450:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788940542.283467:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788940542.283473:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+5:6512:x1875839944790400:12345-0@lo:104: 00010000:00010000:3.0:1788940542.283480:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badcf2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcf33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.283558:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badcf72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcf79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.283566:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badcf72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcf79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.283577:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940542.283581:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02eaaaa00/0x9c34acc08badcf48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcf4f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.283587:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaaaa00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940542.283600:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaaaa00/0x9c34acc08badcf48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcf4f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.283618:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02eaaaa00/0x9c34acc08badcf48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcf4f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940542.283624:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaaaa00/0x9c34acc08badcf48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcf4f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940542.283629:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940542.283852:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d02eaaaa00/0x9c34acc08badcf48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcf4f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.283859:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940542.283866:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02eaaaa00/0x9c34acc08badcf48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcf4f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.283872:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02eaaaa00/0x9c34acc08badcf48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcf4f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.283883:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940542.283884:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940542.283885:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940542.283899:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944790784:0@lo:103: 00000100:00100000:2.0:1788940542.283930:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940542.283963:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940542.283969:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944790912:0@lo:103: 00000100:00100000:2.0:1788940542.284120:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940542.284233:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940542.284245:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+5:6512:x1875839944790400:12345-0@lo:104: Request processed in 773us (1819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940542.284253:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788940542.284291:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788940542.284300:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:6512:x1875839944790528:12345-0@lo:104: 00010000:00010000:3.0:1788940542.284308:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badceed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcef4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.284360:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788940542.284366:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:6512:x1875839944790528:12345-0@lo:104: Request processed in 68us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940542.284372:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788940542.284406:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788940542.284412:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:6512:x1875839944790656:12345-0@lo:104: 00010000:00010000:3.0:1788940542.284420:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d0421c0e00/0x9c34acc08badcec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badceca expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.284448:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788940542.284453:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:6512:x1875839944790656:12345-0@lo:104: Request processed in 42us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940542.284457:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788940542.284578:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944790784 00000100:00100000:2.0:1788940542.284585:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944790784 00010000:00010000:2.0:1788940542.284617:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584d200/0x9c34acc08badcf79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcf72 expref: 20 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940542.284667:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944790912 00000100:00100000:2.0:1788940542.284671:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944790912 00010000:00010000:2.0:1788940542.284683:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d02eaab200/0x9c34acc08badcf4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcf48 expref: 21 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940542.284702:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940542.284708:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:3647:x1875839944790784:12345-0@lo:103: 00010000:00010000:2.0:1788940542.284718:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940542.284723:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584d200/0x9c34acc08badcf79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcf72 expref: 21 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.284733:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584d200/0x9c34acc08badcf79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badcf72 expref: 21 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.284747:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584d200/0x9c34acc08badcf79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badcf72 expref: 21 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.284760:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940542.284788:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:3647:x1875839944790784:12345-0@lo:103: Request processed in 80us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940542.284794:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940542.284807:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940542.284813:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050d8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:3647:x1875839944790912:12345-0@lo:103: 00010000:00010000:2.0:1788940542.284820:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940542.284824:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d02eaab200/0x9c34acc08badcf4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcf48 expref: 19 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.284832:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d02eaab200/0x9c34acc08badcf4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badcf48 expref: 19 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.284848:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaab200/0x9c34acc08badcf4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badcf48 expref: 19 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.284857:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940542.284878:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050d8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:3647:x1875839944790912:12345-0@lo:103: Request processed in 65us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940542.284883:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940542.284944:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944790912:0@lo:103: 00000100:00100000:2.0:1788940542.284952:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944790784:0@lo:103: 00010000:00010000:2.0:1788940542.284977:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788940542.284982:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badcf2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcf33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.285219:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaaa000 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940542.285223:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badcf2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcf33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.285230:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badcf2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcf33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940542.285235:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badcf2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcf33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940542.285241:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940542.285285:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badcf2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcf33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.285291:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940542.285380:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badcf2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcf33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.285388:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badcf2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcf33 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.285399:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940542.285403:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badceed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcef4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.285408:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584da00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940542.285411:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badceed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcef4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.285417:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badceed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcef4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940542.285422:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badceed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcef4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940542.285426:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940542.285439:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badceed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcef4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.285445:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940542.285450:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badceed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcef4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.285456:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badceed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcef4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.285463:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940542.285471:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0421c0e00/0x9c34acc08badcec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badceca expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.285477:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c0e00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940542.285479:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c0e00/0x9c34acc08badcec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badceca expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.285485:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0421c0e00/0x9c34acc08badcec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badceca expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940542.285490:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c0e00/0x9c34acc08badcec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badceca expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940542.285495:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940542.285507:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0421c0e00/0x9c34acc08badcec3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badceca expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.285512:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940542.285523:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0421c0e00/0x9c34acc08badcec3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badceca expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.285528:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0421c0e00/0x9c34acc08badcec3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badceca expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.285540:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940542.285542:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940542.285544:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940542.285555:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944791040:0@lo:103: 00000100:00100000:2.0:1788940542.285583:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940542.285621:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940542.285627:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944791168:0@lo:103: 00000100:00100000:2.0:1788940542.285715:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940542.285738:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940542.285746:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944791296:0@lo:103: 00000100:00100000:2.0:1788940542.285767:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940542.285790:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944791040 00000100:00100000:2.0:1788940542.285794:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944791040 00010000:00010000:2.0:1788940542.285810:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584cc00/0x9c34acc08badcf33 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcf2c expref: 18 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940542.285824:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944791168 00000100:00100000:2.0:1788940542.285826:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944791168 00010000:00010000:2.0:1788940542.285835:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d02eaab000/0x9c34acc08badcef4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badceed expref: 19 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940542.285844:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944791296 00000100:00100000:2.0:1788940542.285847:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944791296 00010000:00010000:2.0:1788940542.285856:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d02eaaac00/0x9c34acc08badceca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcec3 expref: 20 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940542.285868:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788940542.285874:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:3645:x1875839944791040:12345-0@lo:103: 00010000:00010000:2.0:1788940542.285883:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940542.285887:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584cc00/0x9c34acc08badcf33 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcf2c expref: 20 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.285895:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584cc00/0x9c34acc08badcf33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badcf2c expref: 20 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.285905:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940542.285931:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:3645:x1875839944791040:12345-0@lo:103: Request processed in 58us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940542.285943:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788940542.285956:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788940542.285961:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:3645:x1875839944791168:12345-0@lo:103: 00010000:00010000:2.0:1788940542.285968:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940542.285972:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d02eaab000/0x9c34acc08badcef4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badceed expref: 19 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.285980:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d02eaab000/0x9c34acc08badcef4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badceed expref: 19 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940542.286111:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940542.286415:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940542.286439:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:3645:x1875839944791168:12345-0@lo:103: Request processed in 477us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940542.286446:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788940542.286459:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788940542.286466:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:3648:x1875839944791296:12345-0@lo:103: 00010000:00010000:2.0:1788940542.286473:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940542.286477:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d02eaaac00/0x9c34acc08badceca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcec3 expref: 18 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.286485:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d02eaaac00/0x9c34acc08badceca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badcec3 expref: 18 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.286496:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badcfd4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.286504:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badcfd4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.286530:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badcfd4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.286537:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badcfd4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.286544:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badcfd4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.286549:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badcfd4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.286555:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaaa400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940542.286558:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badcfd4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.286566:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badcfd4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.286575:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badcfd4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.286584:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940542.286632:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:3648:x1875839944791296:12345-0@lo:103: Request processed in 167us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940542.286638:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788940542.286682:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944791168:0@lo:103: 00000100:00100000:2.0:1788940542.286692:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944791040:0@lo:103: 00000100:00100000:0.0:1788940542.286918:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944791296:0@lo:103: 00010000:00010000:1.0:1788940542.287116:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584cc00/0x9c34acc08badcf33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badcf2c expref: 17 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940542.287135:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875839944790400:0@lo:104: 00010000:00010000:1.0:1788940542.287148:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaab000/0x9c34acc08badcef4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badceed expref: 16 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940542.287223:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875839944790528:0@lo:104: 00010000:00010000:1.0:1788940542.287236:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaaac00/0x9c34acc08badceca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badcec3 expref: 15 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940542.287244:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875839944790656:0@lo:104: 00010000:00010000:1.0:1788940542.287517:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badcfd4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.287602:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badcfd4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.287617:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badcfd4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.287624:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badcfd4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788940542.287639:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788940542.294232:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944789504:0@lo:253: 10000000:01000000:3.0:1788940542.294250:0:9515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788940542.294254:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000100:00100000:2.0:1788940542.294367:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:9515:x1875839944789504:12345-0@lo:253: Request processed in 24318us (25894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940542.294380:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000020:01000004:3.0:1788940542.294485:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788940542.294486:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940542.294488:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788940542.294489:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940542.294500:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940542.294502:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788940542.294503:0:9515:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788940542.294505:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940542.294506:0:9515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788940542.294529:0:9515:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91d037817800 from lustre-OST0001 10000000:01000000:3.0:1788940542.294559:0:9515:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788940542.294562:0:9515:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788940542.294570:0:9515:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91d00509b3b0 local copy 10000000:01000000:3.0:1788940542.294574:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788940542.294620:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badcfdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.294631:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badcfdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.294640:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badcfdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940542.294728:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944791424:0@lo:101: 00000100:00100000:3.0:1788940542.294767:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940542.294851:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021b4aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940542.294885:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944791424 00000100:00100000:0.0:1788940542.294892:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944791424 00000100:00100000:0.0:1788940542.294934:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788940542.294943:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+14:9515:x1875839944791424:12345-0@lo:101: 00010000:00010000:0.0:1788940542.294955:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940542.294969:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584c400/0x9c34acc08badcfe2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcfdb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940542.295084:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584c400/0x9c34acc08badcfe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcfdb expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940542.295097:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584c400/0x9c34acc08badcfe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcfdb expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940542.295108:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c400, rc 0) 00000100:00100000:0.0:1788940542.295241:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:9515:x1875839944791424:12345-0@lo:101: Request processed in 298us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940542.295247:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788940542.295587:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944791424:0@lo:101: 00010000:00010000:3.0:1788940542.295965:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badcfdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9c34acc08badcfe2 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.295977:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badcfdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9c34acc08badcfe2 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940542.296136:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944791552:0@lo:501: 00000100:00100000:3.0:1788940542.296237:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940542.296471:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021b4aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940542.296579:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944791552 00000100:00100000:2.0:1788940542.296586:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944791552 00000100:00100000:2.0:1788940542.296741:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788940542.296750:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:9515:x1875839944791552:12345-0@lo:501: 00000100:00100000:2.0:1788940542.296873:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:9515:x1875839944791552:12345-0@lo:501: Request processed in 124us (635us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788940542.296881:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788940542.297028:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944791552:0@lo:501: 10000000:01000000:1.0:1788940542.297044:0:9515:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788940542.297065:0:9515:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788940542.297071:0:9515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badcfdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9c34acc08badcfe2 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.297080:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badcfdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9c34acc08badcfe2 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.297087:0:9515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badcfdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9c34acc08badcfe2 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.297279:0:9515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788940542.297309:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91d037817800 10000000:01000000:1.0:1788940542.297331:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788940542.297336:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788940542.297339:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788940542.297344:0:9515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788940542.297346:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788940542.297368:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaaac00/0x9c34acc08badcfe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.297376:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02eaaac00/0x9c34acc08badcfe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.297385:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02eaaac00/0x9c34acc08badcfe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940542.297400:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944791680:0@lo:101: 00000100:00100000:1.0:1788940542.297431:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940542.297454:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021ad9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940542.297655:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944791680 00000100:00100000:0.0:1788940542.297661:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944791680 00000100:00100000:0.0:1788940542.297695:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788940542.297702:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:9515:x1875839944791680:12345-0@lo:101: 00010000:00010000:0.0:1788940542.297710:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940542.297727:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584ca00/0x9c34acc08badcff0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badcfe9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940542.297755:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584ca00/0x9c34acc08badcff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badcfe9 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940542.297765:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584ca00/0x9c34acc08badcff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcfe9 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940542.297772:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584ca00, rc 0) 00000100:00100000:0.0:1788940542.297802:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944791680:12345-0@lo:101: Request processed in 101us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940542.297807:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788940542.297993:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944791680:0@lo:101: 00010000:00010000:1.0:1788940542.298007:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02eaaac00/0x9c34acc08badcfe9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcff0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.298016:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02eaaac00/0x9c34acc08badcfe9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcff0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940542.298077:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944791808:0@lo:501: 00000100:00100000:1.0:1788940542.298101:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940542.298131:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021ad9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940542.298284:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944791808 00000100:00100000:0.0:1788940542.298289:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944791808 00000100:00100000:0.0:1788940542.298381:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788940542.298389:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944791808:12345-0@lo:501: 00000100:00100000:0.0:1788940542.298485:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944791808:12345-0@lo:501: Request processed in 97us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940542.298493:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788940542.298604:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944791808:0@lo:501: 00000100:00100000:1.0:1788940542.298630:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944791936:0@lo:503: 00000100:00100000:1.0:1788940542.298796:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940542.298813:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021ad9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940542.298863:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944791936 00000100:00100000:0.0:1788940542.298868:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944791936 00000100:00100000:0.0:1788940542.298895:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788940542.298901:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944791936:12345-0@lo:503: 00000100:00100000:0.0:1788940542.298978:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944791936:12345-0@lo:503: Request processed in 76us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940542.299044:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788940542.299133:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944791936:0@lo:503: 00000040:00080000:1.0:1788940542.299518:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788940542.299604:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944792064:0@lo:502: 00010000:00010000:3.0:1788940542.301126:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940542.301141:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badcfdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9c34acc08badcfe2 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.301217:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c1200 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940542.301222:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badcfdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9c34acc08badcfe2 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.301233:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badcfdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9c34acc08badcfe2 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940542.301241:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badcfdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9c34acc08badcfe2 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940542.301247:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940542.301410:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badcfdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c34acc08badcfe2 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.301418:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788940542.301473:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788940542.301494:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badcfdb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c34acc08badcfe2 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.301502:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badcfdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9c34acc08badcfe2 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.301522:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940542.301524:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940542.301526:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940542.301710:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940542.301815:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021ad9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940542.301927:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944792064 00000100:00100000:3.0:1788940542.301936:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944792064 00000100:00100000:3.0:1788940542.301994:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788940542.302017:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944792064:12345-0@lo:502: 00000100:00100000:0.0:1788940542.302328:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944792064:0@lo:502: 00000040:00080000:0.0:1788940542.302611:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788940542.302657:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788940542.302676:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788940542.302691:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788940542.302709:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788940542.302726:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788940542.302953:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944792320:0@lo:502: 00000100:00100000:0.0:1788940542.303014:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940542.303041:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06ff00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940542.303176:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944792064:12345-0@lo:502: Request processed in 136us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940542.303186:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788940542.303229:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944792320 00000100:00100000:3.0:1788940542.303235:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944792320 00000100:00100000:3.0:1788940542.303283:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788940542.303290:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944792320:12345-0@lo:502: 00000100:00100000:3.0:1788940542.303561:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944792320:12345-0@lo:502: Request processed in 271us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940542.303567:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788940542.303658:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944792320:0@lo:502: 00000040:00080000:0.0:1788940542.303706:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788940542.303713:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1788940542.304505:0:9526:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788940542.304514:0:9526:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788940542.304521:0:9526:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940542.304523:0:9526:0:(obd_config.c:1662:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788940542.304529:0:9526:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788940542.304557:0:9526:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001 (ffff91cf07a019d8) 00000020:00000080:0.0:1788940542.304584:0:9526:0:(obd_config.c:786:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788940542.304602:0:9526:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788940542.304838:0:9526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d037817800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788940542.304848:0:9526:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788940542.304862:0:9526:0:(genops.c:1393:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9c34acc08badcffe 00000100:00100000:2.0:1788940542.309726:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944792192:0@lo:103: 00000100:00100000:2.0:1788940542.309813:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940542.309978:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944792192 00000100:00100000:3.0:1788940542.309994:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944792192 00000100:00100000:3.0:1788940542.310054:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940542.310064:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:3647:x1875839944792192:12345-0@lo:103: 00010000:00010000:3.0:1788940542.310080:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940542.310100:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584c400/0x9c34acc08badcfe2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badcfdb expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.310116:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940542.310169:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:3647:x1875839944792192:12345-0@lo:103: Request processed in 106us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940542.310176:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940542.310555:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944792192:0@lo:103: 00010000:00010000:0.0:1788940542.318464:0:9526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1788940542.318906:0:9526:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788940542.323507:0:9526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788940542.324080:0:9526:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788940542.335893:0:9526:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788940542.336088:0:9526:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788940542.347571:0:9526:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788940542.361574:0:9526:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788940542.361587:0:9526:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940542.362134:0:9526:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940542.362136:0:9526:0:(obd_config.c:1662:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788940542.362141:0:9526:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940542.362146:0:9526:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940542.362147:0:9526:0:(obd_config.c:1662:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788940542.362512:0:9526:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788940542.362533:0:9526:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788940542.362566:0:9526:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940542.362570:0:9526:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940542.362571:0:9526:0:(obd_config.c:1662:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788940542.362575:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788940542.367867:0:9515:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788940542.367914:0:9515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788940542.367935:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaaac00/0x9c34acc08badcfe9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcff0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.367949:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02eaaac00/0x9c34acc08badcfe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcff0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940542.367957:0:9515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d037817800 from 1 10000000:01000000:1.0:1788940542.367960:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940542.368171:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd005 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.368181:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd005 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.368193:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd005 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940542.368216:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944792448:0@lo:101: 00000100:00100000:1.0:1788940542.368324:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940542.368370:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021ad9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940542.368744:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944792448 00000100:00100000:0.0:1788940542.368757:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944792448 00000100:00100000:0.0:1788940542.368799:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788940542.368807:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:9515:x1875839944792448:12345-0@lo:101: 00010000:00010000:0.0:1788940542.368819:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940542.368832:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584c800/0x9c34acc08badd00c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd005 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940542.368863:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584c800/0x9c34acc08badd00c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd005 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940542.368875:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584c800/0x9c34acc08badd00c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd005 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940542.368885:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c800, rc 0) 00000100:00100000:0.0:1788940542.368939:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944792448:12345-0@lo:101: Request processed in 132us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940542.368945:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788940542.369181:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944792448:0@lo:101: 00010000:00010000:2.0:1788940542.369197:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd005 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd00c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.369206:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd005 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd00c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940542.369761:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944792576:0@lo:501: 00000100:00100000:2.0:1788940542.369800:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940542.369837:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02e9fa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940542.369956:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944792576 00000100:00100000:0.0:1788940542.369962:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944792576 00000100:00100000:0.0:1788940542.370061:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788940542.370071:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944792576:12345-0@lo:501: 00000100:00100000:0.0:1788940542.370234:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944792576:12345-0@lo:501: Request processed in 164us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940542.370241:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788940542.371162:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944792576:0@lo:501: 00000100:00100000:2.0:1788940542.371204:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944792704:0@lo:503: 00000100:00100000:2.0:1788940542.371293:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940542.371546:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02e9fa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940542.371619:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944792704 00000100:00100000:0.0:1788940542.371625:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944792704 00000100:00100000:0.0:1788940542.371660:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788940542.371668:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944792704:12345-0@lo:503: 00000100:00100000:0.0:1788940542.371780:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944792704:12345-0@lo:503: Request processed in 112us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940542.371793:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788940542.371977:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944792704:0@lo:503: 00000040:00080000:2.0:1788940542.372252:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788940542.372728:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944792832:0@lo:502: 00000100:00100000:2.0:1788940542.372775:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940542.372806:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d034717240 going to sleep for 11 seconds 00000100:00100000:0.0:1788940542.372928:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944792832 00000100:00100000:0.0:1788940542.372934:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944792832 00000100:00100000:0.0:1788940542.373075:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788940542.373086:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944792832:12345-0@lo:502: 00000100:00100000:0.0:1788940542.373478:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944792832:12345-0@lo:502: Request processed in 393us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940542.373485:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788940542.373668:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944792832:0@lo:502: 00000040:00080000:1.0:1788940542.374229:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788940542.374306:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788940542.374456:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944792960:0@lo:502: 00000100:00100000:1.0:1788940542.374501:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940542.374533:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021ad99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940542.374729:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944792960 00000100:00100000:2.0:1788940542.374744:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944792960 00000100:00100000:2.0:1788940542.374777:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788940542.374784:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944792960:12345-0@lo:502: 00000100:00100000:2.0:1788940542.374889:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944792960:12345-0@lo:502: Request processed in 105us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940542.374896:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788940542.375307:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944792960:0@lo:502: 00000040:00080000:1.0:1788940542.375523:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788940542.375532:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788940542.382228:0:9530:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940542.382244:0:9530:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940542.382247:0:9530:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788940542.382284:0:9530:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d037817800 00000020:00000080:1.0:1788940542.382289:0:9530:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788940542.382304:0:9530:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940542.382308:0:9530:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940542.382527:0:9530:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788940542.382533:0:9530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788940542.382716:0:9515:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788940542.382758:0:9515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940542.382782:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd005 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd00c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.382796:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd005 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd00c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940542.383500:0:9515:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788940542.383504:0:9515:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91d037817800 10000000:01000000:2.0:1788940542.383508:0:9515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91d037817800 10000000:01000000:2.0:1788940542.383512:0:9515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788940542.383518:0:9515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91d037817800 from 1 10000000:01000000:2.0:1788940542.383520:0:9515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788940542.383555:0:9515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd013 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.383564:0:9515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd013 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.383575:0:9515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd013 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940542.383608:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944793088:0@lo:101: 00000100:00100000:2.0:1788940542.383674:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940542.383816:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d003ac9300 going to sleep for 11 seconds 00000100:00100000:3.0:1788940542.385136:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944793088 00000100:00100000:3.0:1788940542.385157:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944793088 00000100:00100000:3.0:1788940542.385214:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788940542.385224:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9515:x1875839944793088:12345-0@lo:101: 00010000:00010000:3.0:1788940542.385239:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940542.386130:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0421c1200/0x9c34acc08badd01a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd013 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.386174:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0421c1200/0x9c34acc08badd01a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd013 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.386187:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0421c1200/0x9c34acc08badd01a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd013 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.386197:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0421c1200, rc 0) 00000100:00100000:3.0:1788940542.386543:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:9515:x1875839944793088:12345-0@lo:101: Request processed in 1318us (2866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940542.386551:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788940542.390148:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944793088:0@lo:101: 00010000:00010000:2.0:1788940542.390249:0:9515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd013 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd01a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.391699:0:9515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd013 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd01a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940542.391950:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944793216:0@lo:501: 00000100:00100000:2.0:1788940542.392131:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940542.392177:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d003ac9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940542.393033:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944793216 00000100:00100000:1.0:1788940542.393045:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944793216 00000100:00100000:1.0:1788940542.393102:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788940542.393113:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:9515:x1875839944793216:12345-0@lo:501: 00000100:00100000:1.0:1788940542.393298:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:9515:x1875839944793216:12345-0@lo:501: Request processed in 186us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940542.393307:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788940542.394137:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944793216:0@lo:501: 00000100:00100000:3.0:1788940542.394203:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944793344:0@lo:503: 00000100:00100000:3.0:1788940542.394477:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940542.394508:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021b4a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788940542.395898:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944793344 00000100:00100000:2.0:1788940542.395910:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944793344 00000100:00100000:2.0:1788940542.395971:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788940542.395993:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:9515:x1875839944793344:12345-0@lo:503: 00000100:00100000:2.0:1788940542.396141:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:9515:x1875839944793344:12345-0@lo:503: Request processed in 161us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940542.396148:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788940542.396796:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944793344:0@lo:503: 00000040:00080000:3.0:1788940542.397093:0:9515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788940542.397696:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944793472:0@lo:502: 00000100:00100000:3.0:1788940542.397772:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940542.397810:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021b4a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788940542.397886:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944793472 00000100:00100000:2.0:1788940542.397893:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944793472 00000100:00100000:2.0:1788940542.397935:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788940542.397944:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:9515:x1875839944793472:12345-0@lo:502: 00000100:00100000:2.0:1788940542.398064:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:9515:x1875839944793472:12345-0@lo:502: Request processed in 121us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940542.398071:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788940542.399182:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944793472:0@lo:502: 00000040:00080000:3.0:1788940542.399678:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788940542.399717:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788940542.399730:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788940542.399743:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788940542.399767:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788940542.399782:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788940542.399795:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788940542.399808:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788940542.399822:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788940542.399836:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788940542.399920:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788940542.399938:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788940542.399948:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788940542.399960:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788940542.400100:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788940542.400117:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788940542.400129:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788940542.400140:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788940542.400467:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788940542.400489:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788940542.400505:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788940542.400519:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788940542.400532:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788940542.400544:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788940542.400556:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788940542.400571:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788940542.400584:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788940542.400612:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788940542.400625:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788940542.400638:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788940542.400666:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788940542.400683:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788940542.400698:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788940542.400711:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788940542.400734:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788940542.400748:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788940542.400763:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1788940542.400775:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788940542.400787:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1788940542.400800:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1788940542.400815:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1788940542.400830:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1788940542.400845:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1788940542.401229:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1788940542.401241:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1788940542.401251:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1788940542.401351:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944793600:0@lo:502: 00000100:00100000:3.0:1788940542.401424:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940542.401463:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021b4a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788940542.401793:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944793600 00000100:00100000:2.0:1788940542.401802:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944793600 00000100:00100000:2.0:1788940542.401863:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788940542.401873:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:9515:x1875839944793600:12345-0@lo:502: 00000100:00100000:2.0:1788940542.402010:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:9515:x1875839944793600:12345-0@lo:502: Request processed in 138us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940542.402018:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788940542.402100:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944793600:0@lo:502: 00000040:00080000:0.0:1788940542.402164:0:9515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1788940542.402174:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1788940542.403237:0:9531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788940542.403253:0:9531:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91cf07a00000) 00000020:00000080:0.0:1788940542.403545:0:9531:0:(obd_config.c:786:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1788940542.403658:0:9531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d037817800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788940542.403663:0:9531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d037817800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788940542.403666:0:9531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d037817800 3 00010000:00080000:0.0:1788940542.403695:0:9531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91cf07a1e800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.125@tcp at head 00010000:00010000:0.0:1788940542.411787:0:9531:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1788940542.412493:0:9531:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788940542.412544:0:9531:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788940542.412556:0:9531:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9c34acc08badd028 00000100:00080000:0.0:1788940542.412567:0:9531:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788940542.412574:0:9531:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91cf07a1e800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1788940542.412748:0:9531:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d020c8ea00 x1875839944793728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788940542.412775:0:9531:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788940542.412871:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875839944793728:0@lo:38: 00000100:00100000:3.0:1788940542.412944:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940542.413207:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944793728 00000100:00100000:0.0:1788940542.413214:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944793728 00000100:00100000:0.0:1788940542.413253:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788940542.413292:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1875839944793728:12345-0@lo:38: 00010000:00080000:0.0:1788940542.413333:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 297 last 0 00000020:00000080:0.0:1788940542.413364:0:6521:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9c34acc08badd02f 00000004:00100000:0.0:1788940542.413380:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788940542.413415:0:6521:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940542.413468:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875839944793728:12345-0@lo:38: Request processed in 175us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940542.413475:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788940542.413516:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d020c8ea00 x1875839944793728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940542.413526:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788940542.413533:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788940542.413539:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788940542.413543:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788940542.413546:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf07a1e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788940542.413551:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875839944793728:0@lo:38: 00000100:00100000:1.0:1788940542.413996:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944794112:0@lo:400: 00000100:00100000:1.0:1788940542.414031:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940542.414055:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944794624:0@lo:400: 00000100:00100000:1.0:1788940542.414091:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940542.414112:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940542.414118:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944794240:0@lo:400: 00000100:00100000:1.0:1788940542.414139:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940542.414183:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944794112 00000100:00100000:1.0:1788940542.414189:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944794112 00000100:00100000:1.0:1788940542.414222:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788940542.414230:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944794112:12345-0@lo:400: 00000100:00100000:1.0:1788940542.414491:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944794112:12345-0@lo:400: Request processed in 260us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940542.414498:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788940542.414519:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944794624 00000100:00100000:1.0:1788940542.414523:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944794624 00000100:00100000:1.0:1788940542.414559:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940542.414565:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944794624:12345-0@lo:400: 00000100:00100000:1.0:1788940542.414607:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944794624:12345-0@lo:400: Request processed in 42us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940542.414614:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940542.414631:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944794240 00000100:00100000:1.0:1788940542.414635:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944794240 00000100:00100000:1.0:1788940542.414661:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788940542.414667:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944794240:12345-0@lo:400: 00000100:00100000:1.0:1788940542.414696:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944794240:12345-0@lo:400: Request processed in 29us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940542.414701:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788940542.414722:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940542.414726:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940542.414772:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf079e8000 x1875839944794240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940542.414793:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944794240:0@lo:400: 00000100:00100000:1.0:1788940542.414806:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944794112:0@lo:400: 00010000:00080000:1.0:1788940542.414814:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf079eb100 x1875839944794624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940542.414822:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944794624:0@lo:400: 00000100:00100000:3.0:1788940542.415094:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944793856:0@lo:400: 00000100:00100000:3.0:1788940542.415125:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940542.415163:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944794368:0@lo:400: 00000100:00100000:3.0:1788940542.415184:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940542.415204:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788940542.415210:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944793984:0@lo:400: 00000100:00100000:3.0:1788940542.415231:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940542.415244:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944794496:0@lo:400: 00000100:00100000:3.0:1788940542.415298:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940542.415488:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944794496 00000100:00100000:3.0:1788940542.415494:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944794496 00000100:00100000:3.0:1788940542.415536:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940542.415544:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944794496:12345-0@lo:400: 00000100:00100000:3.0:1788940542.415582:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944794496:12345-0@lo:400: Request processed in 39us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940542.415587:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940542.415623:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944793856 00000100:00100000:3.0:1788940542.415626:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944793856 00000100:00100000:3.0:1788940542.415644:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944794368 00000100:00100000:3.0:1788940542.415647:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944794368 00000100:00100000:3.0:1788940542.415660:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944793984 00000100:00100000:3.0:1788940542.415662:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944793984 00000100:00100000:3.0:1788940542.415672:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788940542.415677:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944793856:12345-0@lo:400: 00000100:00100000:3.0:1788940542.415705:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944793856:12345-0@lo:400: Request processed in 28us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940542.415712:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788940542.415722:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788940542.415728:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944794368:12345-0@lo:400: 00000100:00100000:3.0:1788940542.415754:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944794368:12345-0@lo:400: Request processed in 26us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940542.415765:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788940542.415775:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788940542.415781:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944793984:12345-0@lo:400: 00000100:00100000:3.0:1788940542.415805:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944793984:12345-0@lo:400: Request processed in 25us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940542.415811:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788940542.415838:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf079ebb80 x1875839944793984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940542.415860:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944793984:0@lo:400: 00010000:00080000:3.0:1788940542.415871:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf079ea300 x1875839944794496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940542.415879:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944794496:0@lo:400: 00010000:00080000:3.0:1788940542.415887:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf079e8380 x1875839944793856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940542.415895:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944793856:0@lo:400: 00010000:00080000:3.0:1788940542.415903:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf079ea680 x1875839944794368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940542.415910:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944794368:0@lo:400: 00000100:00080000:1.0:1788940542.416201:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940542.416206:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:0.0:1788940542.419538:0:9531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788940542.419554:0:9531:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff91cf07a04d88) 00000020:00000080:0.0:1788940542.419583:0:9531:0:(obd_config.c:786:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1788940542.419691:0:9531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d037817800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788940542.419695:0:9531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d037817800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788940542.419698:0:9531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d037817800 3 00010000:00080000:0.0:1788940542.419728:0:9531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91cf01fdf000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.125@tcp at head 00000100:00100000:2.0:1788940542.421180:0:9532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f9c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9532:1875839944794752:0@lo:901: 00000100:00100000:2.0:1788940542.421285:0:9532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940542.421335:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944794752 00000100:00100000:2.0:1788940542.421342:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944794752 00000100:00100000:2.0:1788940542.421395:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940542.421404:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9532:x1875839944794752:12345-0@lo:901: 00000100:00100000:2.0:1788940542.421484:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9532:x1875839944794752:12345-0@lo:901: Request processed in 80us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940542.421490:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940542.421513:0:9532:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d035895e40 going to sleep for 11 seconds 00010000:00080000:2.0:1788940542.421532:0:9532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d0359f9c00 x1875839944794752/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788940558 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940542.421546:0:9532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f9c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9532:1875839944794752:0@lo:901: 00000100:00080000:3.0:1788940542.424787:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788940542.429692:0:9531:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1788940542.429958:0:9531:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788940542.430178:0:9531:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788940542.430191:0:9531:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x9c34acc08badd03d 00000100:00080000:0.0:1788940542.430202:0:9531:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788940542.430208:0:9531:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff91cf01fdf000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1788940542.430245:0:9531:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d020c8ea00 x1875839944794880/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788940542.430297:0:9531:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788940542.430956:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875839944794880:0@lo:38: 00000100:00100000:1.0:1788940542.431036:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940542.431121:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944794880 00000100:00100000:1.0:1788940542.431129:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944794880 00000100:00100000:1.0:1788940542.431171:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940542.431179:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875839944794880:12345-0@lo:38: 00010000:00080000:1.0:1788940542.431205:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 297 last 0 00000020:00000080:1.0:1788940542.431233:0:6522:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x9c34acc08badd044 00000004:00100000:1.0:1788940542.431248:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788940542.431299:0:6522:0:(import.c:65:import_set_state_nolock()) ffff91cf079fd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940542.431756:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875839944794880:12345-0@lo:38: Request processed in 575us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940542.431764:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788940542.431804:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d020c8ea00 x1875839944794880/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940542.431814:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788940542.431822:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788940542.431836:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788940542.431841:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788940542.431855:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf01fdf000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788940542.431862:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875839944794880:0@lo:38: 00000040:00080000:0.0:1788940542.432105:0:9531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1788940542.432555:0:9515:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1788940542.432605:0:9515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788940542.432624:0:9515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd013 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd01a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940542.432636:0:9515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd01a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788940542.432688:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788940542.432690:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788940542.432692:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940542.432693:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940542.432694:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940542.432696:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940542.432698:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940542.432700:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788940542.432701:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788940542.432703:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940542.432705:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788940542.432708:0:9515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788940542.432711:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788940542.432712:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788940542.432713:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940542.432714:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940542.432720:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940542.432721:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940542.432722:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940542.432723:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788940542.432723:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788940542.432724:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940542.432725:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788940542.432744:0:9515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788940542.432757:0:9515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944795008:0@lo:253: 00000100:00100000:0.0:1788940542.432799:0:9515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940542.432819:0:9515:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d035917780 going to sleep for 11 seconds 00000100:00100000:0.0:1788940542.432842:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944795008 00000100:00100000:0.0:1788940542.432859:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944795008 00000100:00100000:0.0:1788940542.432896:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788940542.432904:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:9515:x1875839944795008:12345-0@lo:253: 20000000:01000000:0.0:1788940542.432928:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788940542.432944:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788940542.454213:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788940542.454237:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788940542.454529:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788940542.454535:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788940542.454560:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d042053200/0x9c34acc08badd04b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.454581:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d02eaaba00/0x9c34acc08badcf41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcf3a expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.454599:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badcf87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcf80 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.454607:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d042053200/0x9c34acc08badd04b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.454658:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badcf87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badcf80 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.454671:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badcf87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badcf80 expref: 17 pid: 6513 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940542.454686:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875839944795136:0@lo:104: 00000100:00100000:2.0:1788940542.454752:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788940542.454800:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d02eaaba00/0x9c34acc08badcf41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badcf3a expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.454809:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d02eaaba00/0x9c34acc08badcf41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badcf3a expref: 17 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940542.454818:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359fb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875839944795264:0@lo:104: 00000100:00100000:2.0:1788940542.454840:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940542.454863:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d035895e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940542.454922:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944795136 00000100:00100000:3.0:1788940542.454929:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944795136 00000100:00100000:3.0:1788940542.454965:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944795264 00000100:00100000:3.0:1788940542.454969:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944795264 00000100:00100000:3.0:1788940542.454995:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788940542.455004:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:6536:x1875839944795136:12345-0@lo:104: 00010000:00010000:3.0:1788940542.455016:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d042052c00/0x9c34acc08badcf80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcf87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.455074:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940542.455080:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:6536:x1875839944795136:12345-0@lo:104: Request processed in 78us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940542.455087:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788940542.455111:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788940542.455117:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:6536:x1875839944795264:12345-0@lo:104: 00010000:00010000:3.0:1788940542.455124:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badcf3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcf41 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.455156:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788940542.455162:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:6536:x1875839944795264:12345-0@lo:104: Request processed in 45us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940542.455168:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788940542.455183:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940542.455188:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d042052c00/0x9c34acc08badcf80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcf87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.455195:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042052c00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940542.455199:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d042052c00/0x9c34acc08badcf80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcf87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.455208:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d042052c00/0x9c34acc08badcf80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcf87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940542.455215:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d042052c00/0x9c34acc08badcf80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcf87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940542.455222:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940542.455247:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d042052c00/0x9c34acc08badcf80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcf87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.455750:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940542.455779:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d042052c00/0x9c34acc08badcf80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcf87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.455799:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d042052c00/0x9c34acc08badcf80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcf87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.455816:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940542.455820:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badcf3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcf41 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.455826:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaab400 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940542.455829:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badcf3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcf41 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.455836:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badcf3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcf41 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940542.455842:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badcf3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcf41 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940542.455847:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940542.455863:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badcf3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcf41 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.455869:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940542.455882:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badcf3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcf41 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.455888:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badcf3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcf41 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940542.455900:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940542.455907:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940542.455909:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940542.455924:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944795520:0@lo:103: 00000100:00100000:3.0:1788940542.455957:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940542.456163:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944795520 00000100:00100000:2.0:1788940542.456169:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944795520 00010000:00010000:2.0:1788940542.456189:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d02eaaba00/0x9c34acc08badcf41 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcf3a expref: 18 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940542.456213:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788940542.456219:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:3645:x1875839944795520:12345-0@lo:103: 00010000:00010000:2.0:1788940542.456229:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940542.456234:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d02eaaba00/0x9c34acc08badcf41 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcf3a expref: 18 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.456254:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d02eaaba00/0x9c34acc08badcf41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badcf3a expref: 18 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.456295:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940542.456449:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940542.456559:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944795392:0@lo:103: 00000100:00100000:1.0:1788940542.456584:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940542.456635:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944795392 00000100:00100000:1.0:1788940542.456639:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944795392 00010000:00010000:1.0:1788940542.456653:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badcf87 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcf80 expref: 19 pid: 6513 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940542.456671:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788940542.456676:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:3648:x1875839944795392:12345-0@lo:103: 00010000:00010000:1.0:1788940542.456683:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940542.456687:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badcf87 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcf80 expref: 19 pid: 6513 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.456695:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badcf87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badcf80 expref: 19 pid: 6513 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.456707:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d042053200/0x9c34acc08badd04b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.456714:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d042053200/0x9c34acc08badd04b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788940542.456727:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013436003s 00010000:00010000:1.0:1788940542.456731:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d042053200/0x9c34acc08badd04b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.456748:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d042053200/0x9c34acc08badd04b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.456756:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d042053200/0x9c34acc08badd04b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.456762:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d042053200/0x9c34acc08badd04b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.456768:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042053200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940542.456772:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d042053200/0x9c34acc08badd04b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.456779:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d042053200/0x9c34acc08badd04b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.456786:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d042053200/0x9c34acc08badd04b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940542.456794:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940542.456827:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:3648:x1875839944795392:12345-0@lo:103: Request processed in 150us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940542.456833:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788940542.460098:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944795392:0@lo:103: 00000100:00100000:0.0:1788940542.460223:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:9515:x1875839944795008:12345-0@lo:253: Request processed in 27319us (27422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940542.460235:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788940542.460332:0:9515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf4e294e-c65c-4988-a227-6e2e705a91d9:9515:1875839944795008:0@lo:253: 10000000:01000000:0.0:1788940542.460345:0:9515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788940542.460349:0:9515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788940542.460351:0:9515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788940542.460352:0:9515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940542.460353:0:9515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940542.460354:0:9515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940542.460355:0:9515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940542.460367:0:9515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940542.460369:0:9515:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788940542.460370:0:9515:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788940542.460372:0:9515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940542.460374:0:9515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788940542.460385:0:9515:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788940542.464582:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:3645:x1875839944795520:12345-0@lo:103: Request processed in 8351us (8612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940542.464607:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1788940542.464694:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badcf87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badcf80 expref: 16 pid: 6513 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940542.464711:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875839944795136:0@lo:104: 00010000:00010000:2.0:1788940542.464722:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaaba00/0x9c34acc08badcf41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badcf3a expref: 15 pid: 6515 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940542.464730:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359fb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875839944795264:0@lo:104: 00010000:00010000:2.0:1788940542.464754:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d042053200/0x9c34acc08badd04b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.464763:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d042053200/0x9c34acc08badd04b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.464770:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d042053200/0x9c34acc08badd04b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940542.464776:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d042053200/0x9c34acc08badd04b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1788940542.466967:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788940542.470934:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788940542.472859:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00000100:00100000:3.0:1788940542.474845:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944795520:0@lo:103: 00080000:10000000:0.0:1788940542.475807:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788940542.478246:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788940542.480130:0:9515:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788940542.484564:0:9515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788940542.498106:0:9515:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788940542.498116:0:9515:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788940542.498216:0:9515:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788940542.498453:0:9515:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788940542.498478:0:9515:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788940542.498501:0:9515:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788940542.500489:0:9515:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788940542.500713:0:9515:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1788940542.619778:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940542.619806:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944795648:0@lo:13: 00000100:00100000:1.0:1788940542.619888:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940542.619984:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944795648 00000100:00100000:1.0:1788940542.620001:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944795648 00000100:00100000:1.0:1788940542.620048:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788940542.620057:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944795648:12345-0@lo:13: 00002000:00000024:1.0:1788940542.620087:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940542.620130:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944795648:12345-0@lo:13: Request processed in 74us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940542.620137:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788940542.620600:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf079e8000 x1875839944795648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940542.620620:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944795648:0@lo:13: 00000100:00100000:0.0:1788940542.629297:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944795776:0@lo:13: 00000100:00100000:0.0:1788940542.629396:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940542.629471:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944795776 00000100:00100000:0.0:1788940542.629480:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944795776 00000100:00100000:0.0:1788940542.629525:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940542.629534:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944795776:12345-0@lo:13: 00002000:00000024:0.0:1788940542.629557:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940542.629612:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944795776:12345-0@lo:13: Request processed in 78us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940542.629619:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788940542.629668:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf079e8000 x1875839944795776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940542.629690:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944795776:0@lo:13: 00010000:00010000:3.0:1788940543.259536:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940543.643548:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944795904:0@lo:41: 00000100:00100000:1.0:1788940543.643646:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940543.643812:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944795904 00000100:00100000:0.0:1788940543.643822:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944795904 00000100:00100000:0.0:1788940543.643876:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788940543.643885:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944795904:12345-0@lo:41: 00000004:00000024:0.0:1788940543.643917:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788940543.643964:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944795904:12345-0@lo:41: Request processed in 80us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940543.643971:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788940543.644316:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944795904:0@lo:41: 00000020:00000004:1.0:1788940543.999034:0:9588:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788940543.999360:0:9588:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788940544.283738:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940545.309544:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940546.331570:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940547.230322:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944796032:0@lo:41: 00000100:00100000:1.0:1788940547.230398:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940547.230475:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944796032 00000100:00100000:1.0:1788940547.230484:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944796032 00000100:00100000:1.0:1788940547.230533:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788940547.230543:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944796032:12345-0@lo:41: 00000004:00000024:1.0:1788940547.230592:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788940547.230638:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944796032:12345-0@lo:41: Request processed in 96us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940547.230646:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788940547.230707:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944796032:0@lo:41: 00010000:00010000:3.0:1788940547.355509:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940547.751722:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944796288:0@lo:13: 00000100:00100000:2.0:1788940547.751824:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940547.751996:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944796288 00000100:00100000:0.0:1788940547.752005:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944796288 00000100:00100000:0.0:1788940547.752065:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940547.752077:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944796288:12345-0@lo:13: 00002000:00000024:0.0:1788940547.752118:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940547.752167:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944796288:12345-0@lo:13: Request processed in 93us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940547.752175:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788940547.752216:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d020c8ed80 x1875839944796288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940547.752235:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944796288:0@lo:13: 00000100:00080000:2.0:1788940547.755000:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940547.755917:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940547.755940:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944796160:0@lo:13: 00000100:00100000:2.0:1788940547.756008:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940547.756491:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944796160 00000100:00100000:3.0:1788940547.756500:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944796160 00000100:00080000:2.0:1788940547.756748:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940547.756983:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788940547.756996:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944796160:12345-0@lo:13: 00002000:00000024:3.0:1788940547.757022:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940547.757087:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944796160:12345-0@lo:13: Request processed in 94us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940547.757094:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788940547.757518:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0359fb480 x1875839944796160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940547.757552:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944796160:0@lo:13: 00000100:00100000:2.0:1788940547.759007:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944796544:0@lo:400: 00000100:00100000:2.0:1788940547.759065:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940547.759094:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944797056:0@lo:400: 00000100:00100000:2.0:1788940547.759123:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940547.759141:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788940547.759148:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944796672:0@lo:400: 00000100:00100000:2.0:1788940547.759169:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940547.759184:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944797184:0@lo:400: 00000100:00100000:2.0:1788940547.759204:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940547.760984:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944796800:0@lo:400: 00000100:00100000:0.0:1788940547.761046:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940547.761092:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944797312:0@lo:400: 00000100:00100000:0.0:1788940547.761127:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940547.761145:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788940547.761151:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944796416:0@lo:400: 00000100:00100000:0.0:1788940547.761196:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940547.761223:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944796928:0@lo:400: 00000100:00100000:0.0:1788940547.761245:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940547.761301:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944797440:0@lo:400: 00000100:00100000:0.0:1788940547.761328:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940547.761376:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944796672 00000100:00100000:3.0:1788940547.761496:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944796416 00000100:00100000:3.0:1788940547.761500:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944796416 00000100:00100000:2.0:1788940547.762709:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944796544 00000100:00100000:2.0:1788940547.762722:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944796544 00000100:00100000:2.0:1788940547.762759:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944797056 00000100:00100000:2.0:1788940547.762762:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944797056 00000100:00100000:2.0:1788940547.762788:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944797184 00000100:00100000:2.0:1788940547.762791:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944797184 00000100:00100000:3.0:1788940547.763242:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788940547.763289:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:3647:x1875839944796416:12345-0@lo:400: 00000100:00100000:3.0:1788940547.763401:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:3647:x1875839944796416:12345-0@lo:400: Request processed in 148us (2205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940547.763408:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788940547.764982:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944796800 00000100:00100000:2.0:1788940547.764995:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944796800 00000100:00100000:2.0:1788940547.765013:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944797312 00000100:00100000:2.0:1788940547.765016:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944797312 00000100:00100000:2.0:1788940547.765051:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944797440 00000100:00100000:2.0:1788940547.765054:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944797440 00000100:00100000:2.0:1788940547.765072:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788940547.765081:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944796544:12345-0@lo:400: 00000100:00100000:1.0:1788940547.766249:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788940547.766317:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944797056:12345-0@lo:400: 00000100:00100000:0.0:1788940547.766904:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944796672 00000100:00100000:0.0:1788940547.766956:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944796928 00000100:00100000:0.0:1788940547.766962:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944796928 00000100:00100000:0.0:1788940547.766975:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788940547.766982:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944796672:12345-0@lo:400: 00000100:00080000:3.0:1788940547.767481:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788940547.767487:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940547.770833:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944797056:12345-0@lo:400: Request processed in 4515us (11699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940547.770847:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788940547.770882:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788940547.770894:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944797184:12345-0@lo:400: 00000100:00100000:0.0:1788940547.771047:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944796672:12345-0@lo:400: Request processed in 4063us (11874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940547.771055:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788940547.771073:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788940547.771081:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944796928:12345-0@lo:400: 00000100:00100000:0.0:1788940547.771112:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944796928:12345-0@lo:400: Request processed in 34us (9866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940547.771117:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788940547.771165:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944796416:0@lo:400: 00000100:00100000:0.0:1788940547.771179:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944796928:0@lo:400: 00000100:00100000:0.0:1788940547.772389:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788940547.772403:0:6522:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788940547.772426:0:8517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788940547.772437:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788940547.772447:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944796800:12345-0@lo:400: 00000100:00100000:0.0:1788940547.772517:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944796800:12345-0@lo:400: Request processed in 72us (11471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940547.772524:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788940547.772551:0:8517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788940547.772566:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788940547.772572:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944797312:12345-0@lo:400: 00000100:00100000:0.0:1788940547.772599:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944797312:12345-0@lo:400: Request processed in 28us (11472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940547.772604:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788940547.772613:0:8517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788940547.772618:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788940547.772624:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944797440:12345-0@lo:400: 00000100:00100000:0.0:1788940547.772645:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944797440:12345-0@lo:400: Request processed in 22us (11317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940547.772650:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788940547.772679:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf079e9500 x1875839944797440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940547.772694:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944797440:0@lo:400: 00010000:00080000:0.0:1788940547.772704:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf079e8380 x1875839944796800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940547.772712:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944796800:0@lo:400: 00010000:00080000:0.0:1788940547.772721:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf079e8a80 x1875839944797312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940547.772728:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944797312:0@lo:400: 00000100:00100000:2.0:1788940547.773122:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944796544:12345-0@lo:400: Request processed in 8041us (14055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940547.773130:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788940547.774069:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944797184:12345-0@lo:400: Request processed in 3178us (14862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940547.774077:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788940547.776719:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944796672:0@lo:400: 00010000:00080000:2.0:1788940547.776742:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf079eaa00 x1875839944797184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940547.776753:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944797184:0@lo:400: 00010000:00080000:2.0:1788940547.776765:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf079e8000 x1875839944796544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940547.776772:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944796544:0@lo:400: 00010000:00080000:2.0:1788940547.776783:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf079ebb80 x1875839944797056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940547.776790:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944797056:0@lo:400: 00010000:00010000:3.0:1788940548.379522:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940548.771033:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944797568:0@lo:41: 00000100:00100000:0.0:1788940548.771126:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940548.771157:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944797568 00000100:00100000:3.0:1788940548.771166:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944797568 00000100:00100000:3.0:1788940548.771224:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788940548.771234:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944797568:12345-0@lo:41: 00000004:00000024:3.0:1788940548.771284:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788940548.771336:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944797568:12345-0@lo:41: Request processed in 103us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940548.771343:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788940548.773292:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944797568:0@lo:41: 10000000:01000000:3.0:1788940549.291464:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788940549.291473:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91d035758800 from 39 10000000:01000000:3.0:1788940549.291479:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788940549.291680:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c0c00/0x9c34acc08badd052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940549.291694:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d0421c0c00/0x9c34acc08badd052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940549.291708:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d0421c0c00/0x9c34acc08badd052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940549.291734:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944797696:0@lo:101: 00000100:00100000:3.0:1788940549.291814:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940549.291873:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d003c36f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940549.293296:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944797696 00000100:00100000:0.0:1788940549.293307:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944797696 00000100:00100000:0.0:1788940549.293373:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788940549.293383:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:6517:x1875839944797696:12345-0@lo:101: 00010000:00010000:0.0:1788940549.293396:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940549.293412:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584cc00/0x9c34acc08badd059 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd052 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.293436:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584cc00/0x9c34acc08badd059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd052 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.293447:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584cc00/0x9c34acc08badd059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd052 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.293455:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584cc00, rc 0) 00000100:00100000:0.0:1788940549.293510:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944797696:12345-0@lo:101: Request processed in 129us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940549.293516:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788940549.293848:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944797696:0@lo:101: 00010000:00010000:0.0:1788940549.293866:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d0421c0c00/0x9c34acc08badd052 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd059 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.293874:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d0421c0c00/0x9c34acc08badd052 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd059 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940549.294173:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944797824:0@lo:501: 00000100:00100000:0.0:1788940549.294315:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.294444:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944797824 00000100:00100000:1.0:1788940549.294451:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944797824 00000100:00100000:1.0:1788940549.294486:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788940549.294494:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944797824:12345-0@lo:501: 00000100:00100000:1.0:1788940549.294635:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944797824:12345-0@lo:501: Request processed in 142us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.294643:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788940549.294849:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0207cdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940549.294864:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944797824:0@lo:501: 00000100:00100000:0.0:1788940549.294893:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944797952:0@lo:503: 00000100:00100000:0.0:1788940549.295191:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940549.295284:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0207cdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940549.295632:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944797952 00000100:00100000:1.0:1788940549.295639:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944797952 00000100:00100000:1.0:1788940549.295678:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788940549.295685:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944797952:12345-0@lo:503: 00000100:00100000:1.0:1788940549.295767:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944797952:12345-0@lo:503: Request processed in 83us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.295774:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788940549.296007:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944797952:0@lo:503: 00000100:00100000:0.0:1788940549.297137:0:9785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9785:1875839944798080:0@lo:502: 00000100:00100000:0.0:1788940549.297993:0:9785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940549.298050:0:9785:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0207cdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940549.298513:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944798080 00000100:00100000:1.0:1788940549.299250:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944798080 00000100:00100000:1.0:1788940549.299336:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788940549.299687:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9785:x1875839944798080:12345-0@lo:502: 00000100:00100000:1.0:1788940549.299872:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9785:x1875839944798080:12345-0@lo:502: Request processed in 526us (2677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.299880:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788940549.300188:0:9785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9785:1875839944798080:0@lo:502: 00000100:00100000:2.0:1788940549.300752:0:9785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9785:1875839944798208:0@lo:502: 00000100:00100000:2.0:1788940549.300803:0:9785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940549.300846:0:9785:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788940549.301438:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944798208 00000100:00100000:1.0:1788940549.301448:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944798208 00000100:00100000:1.0:1788940549.301489:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788940549.301497:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9785:x1875839944798208:12345-0@lo:502: 00000100:00100000:1.0:1788940549.302855:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:9785:x1875839944798208:12345-0@lo:502: Request processed in 1351us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.302867:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788940549.302979:0:9785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9785:1875839944798208:0@lo:502: 00000040:00080000:2.0:1788940549.303015:0:9785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788940549.306317:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788940549.306363:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788940549.306373:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c0c00/0x9c34acc08badd052 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd059 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.306386:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d0421c0c00/0x9c34acc08badd052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd059 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940549.306397:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788940549.306399:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788940549.306402:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788940549.306438:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaab200/0x9c34acc08badd060 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.306446:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02eaab200/0x9c34acc08badd060 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.306475:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02eaab200/0x9c34acc08badd060 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940549.306498:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944798336:0@lo:101: 00000100:00100000:1.0:1788940549.306756:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.306797:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03994d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940549.306849:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944798336 00000100:00100000:2.0:1788940549.306861:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944798336 00000100:00100000:2.0:1788940549.306906:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788940549.306921:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944798336:12345-0@lo:101: 00010000:00010000:2.0:1788940549.306933:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940549.306943:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d042053200/0x9c34acc08badd067 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd060 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940549.306965:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d042053200/0x9c34acc08badd067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd060 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940549.306975:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d042053200/0x9c34acc08badd067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd060 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940549.306983:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d042053200, rc 0) 00000100:00100000:2.0:1788940549.307018:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944798336:12345-0@lo:101: Request processed in 105us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940549.307025:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788940549.307211:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944798336:0@lo:101: 00010000:00010000:1.0:1788940549.307225:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02eaab200/0x9c34acc08badd060 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd067 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.307234:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02eaab200/0x9c34acc08badd060 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd067 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940549.307312:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944798464:0@lo:501: 00000100:00100000:1.0:1788940549.307334:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.307507:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03994d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940549.311051:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944798464 00000100:00100000:2.0:1788940549.311132:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944798464 00000100:00100000:2.0:1788940549.311306:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788940549.311319:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944798464:12345-0@lo:501: 00000100:00100000:2.0:1788940549.311519:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944798464:12345-0@lo:501: Request processed in 203us (4184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.317373:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944798464:0@lo:501: 00000100:00100000:1.0:1788940549.317448:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944798592:0@lo:503: 00000100:00100000:1.0:1788940549.317541:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.317602:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03994d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940549.317696:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944798592 00000100:00100000:0.0:1788940549.317705:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944798592 00000100:00100000:0.0:1788940549.317775:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788940549.317786:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944798592:12345-0@lo:503: 00000100:00100000:0.0:1788940549.317923:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944798592:12345-0@lo:503: Request processed in 138us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940549.317932:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788940549.317982:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944798592:0@lo:503: 00000100:00100000:2.0:1788940549.318026:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788940549.323010:0:9786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9786:1875839944798720:0@lo:502: 00000100:00100000:2.0:1788940549.323103:0:9786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940549.323211:0:9786:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d006999b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940549.324930:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944798720 00000100:00100000:0.0:1788940549.324944:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944798720 00000100:00100000:1.0:1788940549.326509:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788940549.326522:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:9786:x1875839944798720:12345-0@lo:502: 00000100:00100000:1.0:1788940549.326712:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:9786:x1875839944798720:12345-0@lo:502: Request processed in 192us (3609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.326720:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788940549.326781:0:9786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9786:1875839944798720:0@lo:502: 00000020:01000000:2.0:1788940549.326828:0:9786:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940549.326839:0:9786:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940549.326841:0:9786:0:(obd_config.c:1662:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788940549.326847:0:9786:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788940549.326849:0:9786:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788940549.326876:0:9786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9786:1875839944798848:0@lo:502: 00000100:00100000:2.0:1788940549.326918:0:9786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940549.326948:0:9786:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d002a69f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940549.328471:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944798848 00000100:00100000:0.0:1788940549.328483:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944798848 00000100:00100000:0.0:1788940549.328550:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788940549.328560:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:9786:x1875839944798848:12345-0@lo:502: 00000100:00100000:0.0:1788940549.328705:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:9786:x1875839944798848:12345-0@lo:502: Request processed in 147us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940549.328719:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788940549.328759:0:9786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9786:1875839944798848:0@lo:502: 00000020:01000000:2.0:1788940549.328790:0:9786:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940549.328797:0:9786:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940549.328800:0:9786:0:(obd_config.c:1662:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788940549.328805:0:9786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788940549.329677:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788940549.329707:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788940549.329718:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaab200/0x9c34acc08badd060 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd067 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.329730:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02eaab200/0x9c34acc08badd060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd067 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940549.329741:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788940549.329743:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91d034739000 from 39 10000000:01000000:0.0:1788940549.329746:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788940549.329779:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd06e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.329788:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd06e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.329798:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd06e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940549.329818:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944798976:0@lo:101: 00000100:00100000:0.0:1788940549.329862:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940549.329905:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d034717e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940549.329961:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944798976 00000100:00100000:2.0:1788940549.329967:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944798976 00000100:00100000:2.0:1788940549.330013:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788940549.330022:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944798976:12345-0@lo:101: 00010000:00010000:2.0:1788940549.330033:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940549.330045:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d042052c00/0x9c34acc08badd075 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd06e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940549.330067:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d042052c00/0x9c34acc08badd075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd06e expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940549.330078:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d042052c00/0x9c34acc08badd075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd06e expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940549.330087:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d042052c00, rc 0) 00000100:00100000:2.0:1788940549.330120:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944798976:12345-0@lo:101: Request processed in 100us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940549.330132:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788940549.330212:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944798976:0@lo:101: 00010000:00010000:0.0:1788940549.330227:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd06e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd075 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.330235:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd06e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd075 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940549.330326:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944799104:0@lo:501: 00000100:00100000:0.0:1788940549.330351:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940549.330369:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d034717e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940549.330439:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944799104 00000100:00100000:2.0:1788940549.330443:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944799104 00000100:00100000:2.0:1788940549.330467:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788940549.330473:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944799104:12345-0@lo:501: 00000100:00100000:2.0:1788940549.330604:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944799104:12345-0@lo:501: Request processed in 130us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940549.330611:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788940549.331039:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944799104:0@lo:501: 00000100:00100000:0.0:1788940549.331067:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944799232:0@lo:503: 00000100:00100000:0.0:1788940549.331110:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940549.331141:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d034717e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940549.331272:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944799232 00000100:00100000:2.0:1788940549.331277:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944799232 00000100:00100000:2.0:1788940549.331312:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788940549.331320:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944799232:12345-0@lo:503: 00000100:00100000:2.0:1788940549.331402:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944799232:12345-0@lo:503: Request processed in 83us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940549.331410:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788940549.331485:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944799232:0@lo:503: 00000100:00100000:0.0:1788940549.333799:0:9787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9787:1875839944799360:0@lo:502: 00000100:00100000:0.0:1788940549.333888:0:9787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940549.333926:0:9787:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00dffa180 going to sleep for 11 seconds 00000100:00100000:2.0:1788940549.334016:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944799360 00000100:00100000:2.0:1788940549.334025:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944799360 00000100:00100000:2.0:1788940549.334077:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788940549.334087:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:9787:x1875839944799360:12345-0@lo:502: 00000100:00100000:2.0:1788940549.334212:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:9787:x1875839944799360:12345-0@lo:502: Request processed in 125us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940549.334221:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788940549.334321:0:9787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9787:1875839944799360:0@lo:502: 00000100:00100000:2.0:1788940549.334369:0:9787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9787:1875839944799488:0@lo:502: 00000100:00100000:2.0:1788940549.334401:0:9787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940549.334424:0:9787:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d002a69b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940549.334495:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944799488 00000100:00100000:0.0:1788940549.334500:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944799488 00000100:00100000:0.0:1788940549.334541:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788940549.334548:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:9787:x1875839944799488:12345-0@lo:502: 00000100:00100000:0.0:1788940549.334635:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:9787:x1875839944799488:12345-0@lo:502: Request processed in 86us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940549.334642:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788940549.334805:0:9787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9787:1875839944799488:0@lo:502: 00000040:00080000:2.0:1788940549.334825:0:9787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788940549.338756:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788940549.338794:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788940549.338805:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd06e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd075 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.338818:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd06e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd075 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940549.338838:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788940549.338841:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d034739000 from 6 10000000:01000000:0.0:1788940549.338844:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788940549.338885:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badd07c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.338893:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badd07c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.338904:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badd07c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940549.338927:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944799616:0@lo:101: 00000100:00100000:0.0:1788940549.338996:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940549.339039:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00dffa240 going to sleep for 11 seconds 00000100:00100000:1.0:1788940549.339051:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944799616 00000100:00100000:1.0:1788940549.339059:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944799616 00000100:00100000:1.0:1788940549.339625:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788940549.339636:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944799616:12345-0@lo:101: 00010000:00010000:1.0:1788940549.339650:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940549.339667:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaaaa00/0x9c34acc08badd083 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd07c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.339708:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaaaa00/0x9c34acc08badd083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd07c expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.339723:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaaaa00/0x9c34acc08badd083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd07c expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.340701:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaaaa00, rc 0) 00000100:00100000:1.0:1788940549.340769:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:6517:x1875839944799616:12345-0@lo:101: Request processed in 1134us (1771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.340777:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788940549.343148:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944799616:0@lo:101: 00010000:00010000:0.0:1788940549.343183:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badd07c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd083 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.343472:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badd07c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd083 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940549.343633:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944799744:0@lo:256: 00000100:00100000:0.0:1788940549.343699:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940549.343745:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00dffa240 going to sleep for 11 seconds 00000100:00100000:2.0:1788940549.344201:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944799744 00000100:00100000:2.0:1788940549.344209:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944799744 00000100:00100000:2.0:1788940549.344282:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788940549.344292:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:6517:x1875839944799744:12345-0@lo:256: 20000000:01000000:2.0:1788940549.344312:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788940549.344328:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788940549.344331:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788940549.344418:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:6517:x1875839944799744:12345-0@lo:256: Request processed in 128us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940549.344427:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788940549.344445:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944799744:0@lo:256: 10000000:01000000:0.0:1788940549.344490:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788940549.344502:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badd07c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd083 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.344512:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badd07c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd083 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940549.344522:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788940549.349158:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1788940549.349172:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788940549.349235:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badd08a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.349247:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badd08a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.349472:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badd08a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940549.349499:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944799872:0@lo:101: 00000100:00100000:0.0:1788940549.350768:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940549.350832:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00dffa240 going to sleep for 11 seconds 00000100:00100000:1.0:1788940549.351137:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944799872 00000100:00100000:1.0:1788940549.351147:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944799872 00000100:00100000:1.0:1788940549.351191:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788940549.351324:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:6517:x1875839944799872:12345-0@lo:101: 00010000:00010000:1.0:1788940549.351695:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940549.351714:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaabc00/0x9c34acc08badd091 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd08a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.351741:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaabc00/0x9c34acc08badd091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd08a expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.351752:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaabc00/0x9c34acc08badd091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd08a expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.351767:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaabc00, rc 0) 00000100:00100000:1.0:1788940549.351858:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944799872:12345-0@lo:101: Request processed in 539us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.351866:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788940549.358705:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944799872:0@lo:101: 00010000:00010000:0.0:1788940549.358737:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badd08a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd091 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.358751:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badd08a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd091 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940549.358847:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944800000:0@lo:501: 00000100:00100000:0.0:1788940549.358954:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940549.358997:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00dffa240 going to sleep for 11 seconds 00000100:00100000:1.0:1788940549.359269:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944800000 00000100:00100000:1.0:1788940549.359278:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944800000 00000100:00100000:1.0:1788940549.359329:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788940549.359340:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944800000:12345-0@lo:501: 00000100:00100000:1.0:1788940549.359492:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944800000:12345-0@lo:501: Request processed in 153us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.359500:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788940549.359784:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944800000:0@lo:501: 00000100:00100000:1.0:1788940549.359819:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944800128:0@lo:503: 00000100:00100000:1.0:1788940549.359863:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.359895:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03994d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940549.359998:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944800128 00000100:00100000:0.0:1788940549.360004:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944800128 00000100:00100000:0.0:1788940549.360035:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788940549.360042:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944800128:12345-0@lo:503: 00000100:00100000:0.0:1788940549.360138:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944800128:12345-0@lo:503: Request processed in 96us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940549.360145:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788940549.360301:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944800128:0@lo:503: 00000100:00100000:1.0:1788940549.361303:0:9788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9788:1875839944800256:0@lo:502: 00000100:00100000:1.0:1788940549.361364:0:9788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.361398:0:9788:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03994db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940549.361456:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944800256 00000100:00100000:0.0:1788940549.361463:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944800256 00000100:00100000:0.0:1788940549.361501:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788940549.361509:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:9788:x1875839944800256:12345-0@lo:502: 00000100:00100000:0.0:1788940549.361624:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:9788:x1875839944800256:12345-0@lo:502: Request processed in 116us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940549.361642:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788940549.362025:0:9788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9788:1875839944800256:0@lo:502: 00000020:01000000:1.0:1788940549.362054:0:9788:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788940549.362062:0:9788:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788940549.362080:0:9788:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940549.362083:0:9788:0:(obd_config.c:1662:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788940549.362097:0:9788:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788940549.362101:0:9788:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:1.0:1788940549.362124:0:9788:0:(obd_config.c:2073:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788940549.362127:0:9788:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788940549.362142:0:9788:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff91cf06cd99d8) 00000020:00000080:1.0:1788940549.362166:0:9788:0:(obd_config.c:786:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1788940549.362171:0:9788:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788940549.362298:0:9788:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788940549.362304:0:9788:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788940549.362313:0:9788:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9c34acc08badd09f 00010000:00080000:1.0:1788940549.362446:0:9788:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d02ebf6800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1788940549.362856:0:9788:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1788940549.363164:0:9788:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788940549.363178:0:9788:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788940549.363500:0:9788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940549.363910:0:9788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940549.364050:0:9788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788940549.364522:0:9788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788940549.369892:0:9789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940549.369901:0:9789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788940549.386889:0:9788:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788940549.386904:0:9788:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788940549.387456:0:9788:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788940549.387488:0:9788:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08badd0a6 00000100:00080000:1.0:1788940549.387500:0:9788:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788940549.387505:0:9788:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91d02ebf6800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940549.387993:0:9788:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf079eb800 x1875839944800384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940549.388025:0:9788:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788940549.388113:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944800384:0@lo:8: 00000100:00100000:2.0:1788940549.388192:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940549.388281:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944800384 00000100:00100000:2.0:1788940549.388289:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944800384 00000100:00100000:2.0:1788940549.388325:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788940549.388332:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1875839944800384:12345-0@lo:8: 00010000:00080000:2.0:1788940549.388373:0:8524:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:2.0:1788940549.388400:0:8524:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08badd0ad 00002000:00100000:2.0:1788940549.388414:0:8524:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff91d03ec14000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788940549.388419:0:8524:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1788940549.388423:0:8524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788940549.388494:0:8524:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:1.0:1788940549.390325:0:9788:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940549.390336:0:9788:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940549.390349:0:9788:0:(obd_config.c:1662:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788940549.390366:0:9788:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940549.390371:0:9788:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940549.390373:0:9788:0:(obd_config.c:1662:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788940549.390377:0:9788:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788940549.390379:0:9788:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788940549.390420:0:9788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9788:1875839944800512:0@lo:502: 00000100:00100000:1.0:1788940549.390490:0:9788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.390538:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944800512 00000100:00100000:1.0:1788940549.390553:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944800512 00000100:00100000:1.0:1788940549.390597:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788940549.390605:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:9788:x1875839944800512:12345-0@lo:502: 00000100:00100000:1.0:1788940549.390829:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:9788:x1875839944800512:12345-0@lo:502: Request processed in 223us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.390837:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788940549.390881:0:9788:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050f5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940549.390901:0:9788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9788:1875839944800512:0@lo:502: 00000020:01000000:1.0:1788940549.391004:0:9788:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940549.391009:0:9788:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940549.391011:0:9788:0:(obd_config.c:1662:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788940549.391014:0:9788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1788940549.391146:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1788940549.391168:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788940549.391177:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badd08a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd091 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.391189:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badd08a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd091 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940549.391200:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788940549.391209:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91d004f4a000 from 39 10000000:01000000:1.0:1788940549.391212:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788940549.391236:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badd0b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.391244:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badd0b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.391252:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badd0b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940549.391302:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944800640:0@lo:101: 00000100:00100000:1.0:1788940549.391331:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.391346:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050f5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940549.391360:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944800640 00000100:00100000:1.0:1788940549.391364:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944800640 00000100:00100000:1.0:1788940549.391388:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788940549.391394:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944800640:12345-0@lo:101: 00010000:00010000:1.0:1788940549.391403:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940549.391416:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaaa000/0x9c34acc08badd0bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd0b4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.391435:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaaa000/0x9c34acc08badd0bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd0b4 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.391445:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaaa000/0x9c34acc08badd0bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd0b4 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.391453:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaaa000, rc 0) 00000100:00100000:1.0:1788940549.391480:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944800640:12345-0@lo:101: Request processed in 85us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.391491:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788940549.391535:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944800640:0@lo:101: 00002000:00080000:2.0:1788940549.391925:0:8524:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788940549.391952:0:8524:0:(import.c:65:import_set_state_nolock()) ffff91d03ec17800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940549.392004:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3644:x1875839944800384:12345-0@lo:8: Request processed in 3671us (3812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940549.392013:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788940549.392052:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf079eb800 x1875839944800384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788940559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940549.392187:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788940549.392196:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788940549.392204:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788940549.392209:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788940549.392211:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02ebf6800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788940549.392220:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788940549.392225:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944800384:0@lo:8: 00010000:00010000:1.0:1788940549.392431:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badd0b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd0bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.392443:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badd0b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd0bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940549.392498:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944800768:0@lo:501: 00000100:00100000:1.0:1788940549.392539:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.392810:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050f5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940549.392826:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944800768 00000100:00100000:1.0:1788940549.392831:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944800768 00000100:00100000:1.0:1788940549.392877:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788940549.392884:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944800768:12345-0@lo:501: 00000100:00100000:1.0:1788940549.393144:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944800768:12345-0@lo:501: Request processed in 259us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.393151:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788940549.393184:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944800768:0@lo:501: 00000100:00100000:1.0:1788940549.393210:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944800896:0@lo:503: 00000100:00100000:1.0:1788940549.393249:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.393286:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050f5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940549.393298:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944800896 00000100:00100000:1.0:1788940549.393301:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944800896 00000100:00100000:1.0:1788940549.393323:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788940549.393329:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944800896:12345-0@lo:503: 00000100:00100000:0.0:1788940549.394043:0:9790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9790:1875839944801024:0@lo:700: 00000100:00100000:0.0:1788940549.394100:0:9790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940549.394122:0:9790:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00dffab40 going to sleep for 11 seconds 00000004:00080000:0.0:1788940549.394138:0:9789:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788940549.394320:0:9789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 304727062639ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788940549.394328:0:9789:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788940549.394603:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944800896:12345-0@lo:503: Request processed in 1272us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.394611:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788940549.394787:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944800896:0@lo:503: 00000100:00100000:1.0:1788940549.397354:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944801152:0@lo:400: 00000100:00100000:1.0:1788940549.397421:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.397459:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839944801664:0@lo:400: 00000100:00100000:1.0:1788940549.397484:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.397501:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944802176:0@lo:400: 00000100:00100000:1.0:1788940549.397519:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.397565:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788940549.397572:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944801536:0@lo:400: 00000100:00100000:1.0:1788940549.397594:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.397613:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944802048:0@lo:400: 00000100:00100000:1.0:1788940549.397646:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.397680:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944801152 00000100:00100000:1.0:1788940549.397688:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944801152 00000100:00100000:1.0:1788940549.397727:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944801664 00000100:00100000:1.0:1788940549.397731:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944801664 00000100:00100000:1.0:1788940549.398302:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944802176 00000100:00100000:1.0:1788940549.398307:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944802176 00000100:00100000:1.0:1788940549.398320:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944801536 00000100:00100000:1.0:1788940549.398322:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944801536 00000100:00100000:1.0:1788940549.398331:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944802048 00000100:00100000:1.0:1788940549.398333:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944802048 00000100:00100000:1.0:1788940549.398359:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788940549.398367:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944801152:12345-0@lo:400: 00000100:00100000:1.0:1788940549.398440:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944801152:12345-0@lo:400: Request processed in 74us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.398447:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788940549.398466:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788940549.398472:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839944801664:12345-0@lo:400: 00000100:00100000:1.0:1788940549.398499:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839944801664:12345-0@lo:400: Request processed in 28us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.398504:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788940549.398515:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788940549.398521:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944802176:12345-0@lo:400: 00000100:00100000:1.0:1788940549.398569:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944802176:12345-0@lo:400: Request processed in 48us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.398575:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788940549.398586:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788940549.398591:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944801536:12345-0@lo:400: 00000100:00100000:1.0:1788940549.398617:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944801536:12345-0@lo:400: Request processed in 26us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.398623:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788940549.398739:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788940549.398747:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944802048:12345-0@lo:400: 00000100:00100000:1.0:1788940549.398778:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944802048:12345-0@lo:400: Request processed in 32us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.398784:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788940549.398818:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940549.398822:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788940549.398850:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f5ce00 x1875839944801536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940549.398871:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944801536:0@lo:400: 00010000:00080000:1.0:1788940549.398885:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03475a300 x1875839944802048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940549.398893:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944802048:0@lo:400: 00010000:00080000:1.0:1788940549.398902:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f5df80 x1875839944801152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940549.398909:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944801152:0@lo:400: 00010000:00080000:1.0:1788940549.399041:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f5ea00 x1875839944801664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940549.399050:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839944801664:0@lo:400: 00010000:00080000:1.0:1788940549.399059:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03588f100 x1875839944802176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940549.399139:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944802176:0@lo:400: 00000100:00100000:1.0:1788940549.399702:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944801408:0@lo:400: 00000100:00100000:1.0:1788940549.399746:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.399772:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944801920:0@lo:400: 00000100:00100000:1.0:1788940549.399796:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.399818:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788940549.399824:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944801280:0@lo:400: 00000100:00100000:1.0:1788940549.399845:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.399863:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944801792:0@lo:400: 00000100:00100000:1.0:1788940549.399879:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940549.400059:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944801024 00000100:00100000:2.0:1788940549.400077:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944801024 00000100:00100000:2.0:1788940549.402243:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940549.402270:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9790:x1875839944801024:12345-0@lo:700: 00000100:00100000:2.0:1788940549.402330:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8446:1875839944802304:0@lo:700: 00000100:00100000:2.0:1788940549.402396:0:8446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940549.402426:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0207cdc00 going to sleep for 11 seconds 00010000:00010000:2.0:1788940549.404523:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788940549.409779:0:7452:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788940549.410806:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944801920 00000100:00100000:2.0:1788940549.410820:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944801920 00000100:00100000:2.0:1788940549.410874:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944801792 00000100:00100000:2.0:1788940549.410877:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944801792 00000100:00100000:2.0:1788940549.410904:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788940549.410926:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944801920:12345-0@lo:400: 00000100:00100000:2.0:1788940549.411030:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944801920:12345-0@lo:400: Request processed in 107us (11232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940549.411045:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788940549.411710:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d034758a80 x1875839944801920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940549.411727:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944801920:0@lo:400: 00000100:00100000:1.0:1788940549.411758:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944802304 00000100:00100000:1.0:1788940549.411762:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944802304 00000100:00100000:1.0:1788940549.411797:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940549.411804:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8446:x1875839944802304:12345-0@lo:700: 00000100:00080000:1.0:1788940549.411964:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940549.411969:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940549.412493:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940549.412508:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944801792:12345-0@lo:400: 00000100:00100000:2.0:1788940549.413441:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944801792:12345-0@lo:400: Request processed in 934us (13555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940549.413451:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940549.413495:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944801280 00000100:00100000:2.0:1788940549.413502:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944801280 00010000:00080000:1.0:1788940549.413758:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d034759180 x1875839944801792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940549.413772:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944801792:0@lo:400: 00000100:00100000:2.0:1788940549.413831:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788940549.413841:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944801280:12345-0@lo:400: 00000100:00100000:2.0:1788940549.413895:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944801280:12345-0@lo:400: Request processed in 57us (14049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940549.413901:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788940549.414451:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944801280:0@lo:400: 00000100:00100000:2.0:1788940549.415007:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944801408 00000100:00100000:2.0:1788940549.415014:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944801408 00000100:00100000:2.0:1788940549.415050:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788940549.415058:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944801408:12345-0@lo:400: 00000100:00100000:2.0:1788940549.415832:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944801408:12345-0@lo:400: Request processed in 770us (16081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940549.415843:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788940549.416299:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f5c000 x1875839944801408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940549.416314:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944801408:0@lo:400: 00000100:00100000:2.0:1788940549.416810:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9792:1875839944802432:0@lo:502: 00000100:00100000:2.0:1788940549.416870:0:9792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940549.416909:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359176c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940549.417308:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944802432 00000100:00100000:0.0:1788940549.417315:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944802432 00000100:00100000:0.0:1788940549.417429:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788940549.417438:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:9792:x1875839944802432:12345-0@lo:502: 00000100:00100000:0.0:1788940549.418754:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:9792:x1875839944802432:12345-0@lo:502: Request processed in 1313us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940549.418764:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788940549.419042:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9792:1875839944802432:0@lo:502: 00000100:00100000:2.0:1788940549.419191:0:9792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9792:1875839944802560:0@lo:502: 00000100:00100000:2.0:1788940549.419244:0:9792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940549.420228:0:9792:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02e9fa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940549.420442:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944802560 00000100:00100000:2.0:1788940549.420451:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944802560 00000100:00100000:2.0:1788940549.420497:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788940549.420505:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:9792:x1875839944802560:12345-0@lo:502: 00000100:00100000:2.0:1788940549.422472:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:9792:x1875839944802560:12345-0@lo:502: Request processed in 1960us (3221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940549.422484:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788940549.422880:0:9792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9792:1875839944802560:0@lo:502: 40000000:02000000:2.0:1788940549.423234:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000040:00080000:0.0:1788940549.423718:0:9792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788940549.424001:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788940549.424028:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788940549.424039:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badd0b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd0bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940549.424050:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badd0b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd0bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940549.424060:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788940549.424705:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d004f4a000 from 6 10000000:01000000:3.0:1788940549.424709:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788940549.424744:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badd0c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940549.424754:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badd0c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940549.424764:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badd0c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940549.424785:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944802688:0@lo:101: 00000100:00100000:3.0:1788940549.424846:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940549.424886:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d003c36240 going to sleep for 11 seconds 00000100:00100000:0.0:1788940549.425161:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944802688 00000100:00100000:0.0:1788940549.425169:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944802688 00000100:00100000:0.0:1788940549.425216:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788940549.425226:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944802688:12345-0@lo:101: 00010000:00010000:0.0:1788940549.425240:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940549.425254:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584dc00/0x9c34acc08badd0c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd0c2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.425292:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584dc00/0x9c34acc08badd0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd0c2 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.425302:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584dc00/0x9c34acc08badd0c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd0c2 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.425310:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584dc00, rc 0) 00000100:00100000:3.0:1788940549.429398:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944802688:0@lo:101: 00010000:00010000:3.0:1788940549.429427:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badd0c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd0c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940549.429440:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badd0c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd0c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940549.429515:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944802816:0@lo:256: 00000100:00100000:3.0:1788940549.429595:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940549.429645:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d003c36240 going to sleep for 11 seconds 00000100:00100000:3.0:1788940549.435246:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944802816 00000100:00100000:3.0:1788940549.435274:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944802816 00000100:00100000:3.0:1788940549.435324:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788940549.435334:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944802816:12345-0@lo:256: 20000000:01000000:3.0:1788940549.436008:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788940549.436033:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788940549.436037:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788940549.436725:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944802688:12345-0@lo:101: Request processed in 11496us (11874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940549.436735:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788940549.439700:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8446:x1875839944802304:12345-0@lo:700: Request processed in 27888us (37295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940549.439715:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788940549.439771:0:8446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0359f8000 x1875839944802304/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788940565 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940549.439786:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8446:1875839944802304:0@lo:700: 40000000:02000000:2.0:1788940549.439801:0:8446:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:3.0:1788940549.440897:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944802816:12345-0@lo:256: Request processed in 5559us (11294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940549.440908:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788940549.445247:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944802816:0@lo:256: 10000000:01000000:0.0:1788940549.445493:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788940549.445504:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badd0c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd0c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.445540:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badd0c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd0c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940549.446425:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788940549.446428:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788940549.446431:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788940549.446486:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd0d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.446496:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd0d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.446505:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd0d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940549.446536:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944802944:0@lo:101: 00000100:00100000:0.0:1788940549.447208:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940549.447253:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940549.448231:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944802944 00000100:00100000:0.0:1788940549.448242:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944802944 00000100:00100000:0.0:1788940549.448741:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788940549.448754:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944802944:12345-0@lo:101: 00010000:00010000:0.0:1788940549.448772:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940549.448790:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584c200/0x9c34acc08badd0d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd0d0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.448820:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584c200/0x9c34acc08badd0d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd0d0 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.448849:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584c200/0x9c34acc08badd0d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd0d0 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940549.448859:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c200, rc 0) 00000100:00100000:0.0:1788940549.449023:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944802944:12345-0@lo:101: Request processed in 272us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940549.449030:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788940549.456814:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944802944:0@lo:101: 00010000:00010000:3.0:1788940549.456844:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd0d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd0d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940549.456857:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd0d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd0d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940549.457015:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944803072:0@lo:501: 00000100:00100000:3.0:1788940549.457079:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940549.457187:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d003c36000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940549.457842:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944803072 00000100:00100000:2.0:1788940549.457852:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944803072 00000100:00100000:2.0:1788940549.458131:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788940549.458144:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944803072:12345-0@lo:501: 00000100:00100000:2.0:1788940549.458304:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944803072:12345-0@lo:501: Request processed in 162us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940549.458311:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788940549.459401:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944803072:0@lo:501: 00000100:00100000:3.0:1788940549.459455:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944803200:0@lo:503: 00000100:00100000:3.0:1788940549.459513:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.459724:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944803200 00000100:00100000:1.0:1788940549.459731:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944803200 00000100:00100000:1.0:1788940549.459775:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788940549.459784:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944803200:12345-0@lo:503: 00000100:00100000:1.0:1788940549.459883:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944803200:12345-0@lo:503: Request processed in 100us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.459890:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788940549.460036:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d003c36000 going to sleep for 11 seconds 00000100:00100000:3.0:1788940549.460049:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944803200:0@lo:503: 00000001:00100000:2.0:1788940549.464137:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788940549.465408:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9790:x1875839944801024:12345-0@lo:700: Request processed in 63147us (71300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940549.465432:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788940549.466273:0:9790:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06108700 x1875839944801024/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788940565 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940549.466290:0:9790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9790:1875839944801024:0@lo:700: 00000100:00100000:3.0:1788940549.475437:0:9797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9797:1875839944803328:0@lo:502: 00000100:00100000:3.0:1788940549.475533:0:9797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940549.476466:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944803328 00000100:00100000:3.0:1788940549.476477:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944803328 00000100:00100000:3.0:1788940549.476537:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788940549.476855:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:9797:x1875839944803328:12345-0@lo:502: 00000100:00100000:3.0:1788940549.477222:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:9797:x1875839944803328:12345-0@lo:502: Request processed in 676us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940549.477231:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788940549.477304:0:9797:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d003c36000 going to sleep for 11 seconds 00000100:00100000:3.0:1788940549.477329:0:9797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9797:1875839944803328:0@lo:502: 00000020:01000000:3.0:1788940549.478253:0:9797:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788940549.478289:0:9797:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788940549.478297:0:9797:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940549.478299:0:9797:0:(obd_config.c:1662:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788940549.478305:0:9797:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788940549.478309:0:9797:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:3.0:1788940549.478335:0:9797:0:(obd_config.c:2073:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788940549.478338:0:9797:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788940549.479006:0:9797:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91cf0844b3b0) 00000020:00000080:3.0:1788940549.479037:0:9797:0:(obd_config.c:786:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1788940549.479047:0:9797:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788940549.479168:0:9797:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788940549.479175:0:9797:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788940549.479182:0:9797:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08badd0e5 00010000:00080000:3.0:1788940549.479215:0:9797:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91cf08451800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:3.0:1788940549.482320:0:9797:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1788940549.484056:0:9797:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788940549.484088:0:9797:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788940549.484293:0:9797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788940549.484587:0:9790:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788940549.484616:0:9790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9790:1875839944803584:0@lo:7: 00000100:00100000:1.0:1788940549.484741:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944803456:0@lo:13: 00000100:00100000:1.0:1788940549.484812:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.484884:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944803456 00000100:00100000:1.0:1788940549.484893:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944803456 00000100:00100000:0.0:1788940549.485605:0:9790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940549.487521:0:9790:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06240 going to sleep for 11 seconds 00000100:00100000:1.0:1788940549.487734:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940549.487752:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944803456:12345-0@lo:13: 00002000:00000024:1.0:1788940549.487789:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1788940549.487869:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944803456:12345-0@lo:13: Request processed in 124us (3057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.487876:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788940549.488024:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944803584 00000100:00100000:2.0:1788940549.488034:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944803584 00000100:00100000:2.0:1788940549.488086:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940549.488094:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9790:x1875839944803584:12345-0@lo:7: 00010000:00080000:1.0:1788940549.489038:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ee3100 x1875839944803456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940549.489796:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944803456:0@lo:13: 00000040:00080000:3.0:1788940549.490348:0:9797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940549.491193:0:9797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788940549.492035:0:9797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788940549.513141:0:9802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940549.513150:0:9802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00002000:00080000:2.0:1788940549.513827:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788940549.513834:0:8437:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00010000:00080000:0.0:1788940549.513998:0:9790:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ee0700 x1875839944803584/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788940565 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940549.514017:0:9790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9790:1875839944803584:0@lo:7: 00000004:00080000:0.0:1788940549.514034:0:9790:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788940549.514080:0:9790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9790:1875839944803712:0@lo:5: 00000020:00000080:1.0:1788940549.516290:0:9797:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788940549.516307:0:9797:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788940549.516364:0:9797:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788940549.516391:0:9797:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08badd0ec 00000100:00080000:1.0:1788940549.516401:0:9797:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788940549.516407:0:9797:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91cf08451800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940549.516442:0:9797:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d034759180 x1875839944803840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940549.516471:0:9797:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788940549.516521:0:9797:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940549.516537:0:9797:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940549.516539:0:9797:0:(obd_config.c:1662:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788940549.516711:0:9797:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940549.516717:0:9797:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940549.516719:0:9797:0:(obd_config.c:1662:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788940549.516723:0:9797:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788940549.516724:0:9797:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788940549.516753:0:9797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9797:1875839944803968:0@lo:502: 00000100:00100000:0.0:1788940549.520092:0:9790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940549.520151:0:9790:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06240 going to sleep for 11 seconds 00000100:00100000:2.0:1788940549.523004:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9790:x1875839944803584:12345-0@lo:7: Request processed in 34902us (37391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940549.523019:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940549.523134:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944803840:0@lo:8: 00000100:00100000:2.0:1788940549.523203:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940549.523296:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944803712 00000100:00100000:2.0:1788940549.523305:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944803712 00000100:00100000:2.0:1788940549.523408:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944803840 00000100:00100000:2.0:1788940549.523413:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944803840 00000100:00100000:2.0:1788940549.523430:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788940549.523439:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9790:x1875839944803712:12345-0@lo:5: 00002000:00080000:2.0:1788940549.523471:0:8524:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788940549.523513:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9790:x1875839944803712:12345-0@lo:5: Request processed in 76us (3427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940549.523519:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788940549.523716:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788940549.523723:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1875839944803840:12345-0@lo:8: 00010000:00080000:3.0:1788940549.523759:0:8438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:3.0:1788940549.523786:0:8438:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08badd0f3 00002000:00100000:3.0:1788940549.523800:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91cf08450000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788940549.523805:0:8438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788940549.523808:0:8438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788940549.523889:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00010000:00080000:2.0:1788940549.524012:0:9790:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ee0700 x1875839944803712/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940565 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940549.524027:0:9790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9790:1875839944803712:0@lo:5: 00000004:00080000:2.0:1788940549.524039:0:9790:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00080000:3.0:1788940549.524133:0:8438:0:(import.c:65:import_set_state_nolock()) ffff91cf08453000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940549.524181:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875839944803840:12345-0@lo:8: Request processed in 457us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940549.524188:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788940549.524333:0:9790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9790:1875839944804096:0@lo:5: 00000100:00100000:2.0:1788940549.524427:0:9790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940549.524483:0:9790:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0207cdc00 going to sleep for 11 seconds 00010000:00080000:2.0:1788940549.524506:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d034759180 x1875839944803840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788940559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940549.524515:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788940549.524522:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788940549.524540:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788940549.524555:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788940549.524558:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf08451800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788940549.524575:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788940549.524580:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944803840:0@lo:8: 00000004:00080000:1.0:1788940549.525306:0:9802:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788940549.525522:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944804096 00000100:00100000:0.0:1788940549.525571:0:9797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940549.525616:0:9797:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06eb3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788940549.525738:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944803968 00000100:00100000:1.0:1788940549.525747:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944803968 00000100:00100000:1.0:1788940549.525785:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788940549.525793:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:9797:x1875839944803968:12345-0@lo:502: 00000100:00100000:1.0:1788940549.525920:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:9797:x1875839944803968:12345-0@lo:502: Request processed in 117us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.525927:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788940549.526032:0:9797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:9797:1875839944803968:0@lo:502: 00000020:01000000:0.0:1788940549.526066:0:9797:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940549.526075:0:9797:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940549.526078:0:9797:0:(obd_config.c:1662:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788940549.526082:0:9797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000004:00080000:1.0:1788940549.526549:0:9802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 304859283751ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788940549.526558:0:9802:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:1.0:1788940549.527347:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1788940549.527408:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788940549.527420:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd0d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd0d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.527432:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd0d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd0d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940549.527442:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788940549.527444:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91d00509b3b0 from 1 10000000:01000000:1.0:1788940549.527447:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788940549.527478:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa400/0x9c34acc08badd0fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.527494:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa400/0x9c34acc08badd0fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.527503:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa400/0x9c34acc08badd0fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940549.527555:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944804224:0@lo:101: 00000100:00100000:1.0:1788940549.527612:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.528011:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06eb3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788940549.529010:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944804096 00000100:00100000:3.0:1788940549.529396:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788940549.529416:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9790:x1875839944804096:12345-0@lo:5: 00002000:00080000:3.0:1788940549.529465:0:8524:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1788940549.529771:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940549.529786:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944804352:0@lo:13: 00000100:00100000:2.0:1788940549.529891:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940549.529946:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944804352 00000100:00100000:2.0:1788940549.529950:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944804352 00000100:00100000:2.0:1788940549.529989:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788940549.529996:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875839944804352:12345-0@lo:13: 00002000:00000024:2.0:1788940549.530011:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923808256 avail 3692285952 00000100:00100000:2.0:1788940549.530053:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875839944804352:12345-0@lo:13: Request processed in 57us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940549.530060:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788940549.530097:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788940549.530127:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f3aa00 x1875839944804352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940549.530159:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944804352:0@lo:13: 00000004:00080000:2.0:1788940549.530179:0:9805:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788940549.530199:0:9805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f3aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9805:1875839944804480:0@lo:7: 00000100:00100000:2.0:1788940549.530225:0:9805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788940549.532518:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788940549.533875:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9790:x1875839944804096:12345-0@lo:5: Request processed in 4465us (9443us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788940549.533888:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788940549.534238:0:9790:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f38e00 x1875839944804096/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940565 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940549.534286:0:9790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9790:1875839944804096:0@lo:5: 00000004:00080000:0.0:1788940549.534305:0:9790:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788940549.534352:0:9790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9790:1875839944804608:0@lo:900: 00000100:00100000:0.0:1788940549.534391:0:9790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940549.534416:0:9790:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb060c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940549.534426:0:9805:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359176c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940549.534496:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944804224 00000100:00100000:3.0:1788940549.534504:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944804224 00000100:00100000:3.0:1788940549.534570:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788940549.534580:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944804224:12345-0@lo:101: 00010000:00010000:3.0:1788940549.534594:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940549.534612:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0421c0a00/0x9c34acc08badd101 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd0fa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940549.534743:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944804608 00000100:00100000:0.0:1788940549.534748:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944804608 00010000:00010000:3.0:1788940549.534763:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0421c0a00/0x9c34acc08badd101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd0fa expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940549.534780:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788940549.534786:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0421c0a00/0x9c34acc08badd101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd0fa expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940549.534793:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9790:x1875839944804608:12345-0@lo:900: 00010000:00010000:3.0:1788940549.534801:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0421c0a00, rc 0) 00000100:00100000:1.0:1788940549.535240:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944804480 00000100:00100000:1.0:1788940549.535246:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944804480 00000100:00100000:1.0:1788940549.535313:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944804224:0@lo:101: 00010000:00010000:1.0:1788940549.535330:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa400/0x9c34acc08badd0fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd101 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940549.535336:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9790:x1875839944804608:12345-0@lo:900: Request processed in 546us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940549.535346:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788940549.535437:0:9790:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ee1f80 x1875839944804608/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788940565 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940549.535448:0:9790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9790:1875839944804608:0@lo:900: 00010000:00010000:1.0:1788940549.535505:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa400/0x9c34acc08badd0fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd101 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940549.535712:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944804736:0@lo:501: 00000100:00100000:0.0:1788940549.535721:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940549.535733:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9805:x1875839944804480:12345-0@lo:7: 00000100:00100000:1.0:1788940549.535753:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940549.535780:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06eb3900 going to sleep for 11 seconds 00000100:00100000:1.0:1788940549.535795:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944804736 00000100:00100000:1.0:1788940549.535800:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944804736 00000100:00100000:1.0:1788940549.535829:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788940549.535837:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+25:6517:x1875839944804736:12345-0@lo:501: 00000100:00100000:1.0:1788940549.535980:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+25:6517:x1875839944804736:12345-0@lo:501: Request processed in 73us (157us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788940549.535989:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788940549.536025:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944804736:0@lo:501: 10000000:01000000:1.0:1788940549.536059:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00000100:00100000:3.0:1788940549.536215:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944804224:12345-0@lo:101: Request processed in 1635us (8601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940549.536222:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00010000:00010000:1.0:1788940549.536434:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa400/0x9c34acc08badd0fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd101 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940549.536451:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa400/0x9c34acc08badd0fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd101 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788940549.547415:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788940549.547425:0:8439:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788940549.547514:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9805:x1875839944804480:12345-0@lo:7: Request processed in 11781us (17285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940549.547536:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788940549.547792:0:9805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f3aa00 x1875839944804480/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788940565 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940549.548079:0:9805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f3aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9805:1875839944804480:0@lo:7: 00000004:00080000:0.0:1788940549.548343:0:9805:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788940549.548395:0:9805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9805:1875839944804864:0@lo:5: 00000100:00100000:0.0:1788940549.548440:0:9805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940549.548461:0:9805:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940549.551491:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944804864 00000100:00100000:1.0:1788940549.551508:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944804864 00000100:00100000:1.0:1788940549.551593:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940549.551605:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9805:x1875839944804864:12345-0@lo:5: 00002000:00080000:1.0:1788940549.551654:0:8524:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788940549.551658:0:8524:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1788940549.564898:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1788940549.564920:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788940549.564926:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788940549.566404:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9805:x1875839944804864:12345-0@lo:5: Request processed in 14792us (17954us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788940549.566418:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788940549.566547:0:9805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ee2d80 x1875839944804864/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940565 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940549.566561:0:9805:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788940549.566580:0:9805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9805:1875839944804864:0@lo:5: 00000004:00080000:3.0:1788940549.566598:0:9805:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788940549.566653:0:9805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9805:1875839944804992:0@lo:700: 00000100:00100000:3.0:1788940549.566692:0:9805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940549.566728:0:9805:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d003c36e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940549.566783:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944804992 00000100:00100000:2.0:1788940549.566791:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944804992 00000100:00100000:2.0:1788940549.566847:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940549.566858:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9805:x1875839944804992:12345-0@lo:700: 00000100:00100000:3.0:1788940549.588825:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9805:x1875839944804992:12345-0@lo:700: Request processed in 21960us (22122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940549.588840:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788940549.588983:0:9805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03588ce00 x1875839944804992/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788940565 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940549.588998:0:9805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9805:1875839944804992:0@lo:700: 00000004:02000040:3.0:1788940549.596722:0:9805:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1788940549.600052:0:9805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9805:1875839944805120:0@lo:5: 00000100:00100000:3.0:1788940549.600131:0:9805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940549.600200:0:9805:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d003c36600 going to sleep for 11 seconds 00000100:00100000:1.0:1788940549.603493:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944805120 00000100:00100000:1.0:1788940549.603510:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944805120 00000100:00100000:1.0:1788940549.603628:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788940549.603645:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9805:x1875839944805120:12345-0@lo:5: 00002000:00080000:1.0:1788940549.619052:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788940549.619073:0:8439:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1788940549.633148:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9805:x1875839944805120:12345-0@lo:5: Request processed in 29500us (33010us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788940549.633162:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788940549.633225:0:9805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03588c380 x1875839944805120/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940565 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940549.633242:0:9805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9805:1875839944805120:0@lo:5: 00000004:00080000:1.0:1788940549.633286:0:9805:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:1.0:1788940550.429666:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940551.457847:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788940551.522014:0:9889:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788940552.348127:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944805248:0@lo:41: 00000100:00100000:2.0:1788940552.348206:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940552.356110:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944805248 00000100:00100000:0.0:1788940552.356126:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944805248 00000100:00100000:0.0:1788940552.356190:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788940552.356201:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944805248:12345-0@lo:41: 00000004:00000024:0.0:1788940552.356251:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788940552.356357:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944805248:12345-0@lo:41: Request processed in 158us (8151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940552.356364:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788940552.356444:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944805248:0@lo:41: 00010000:00010000:2.0:1788940552.475979:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788940552.494798:0:9941:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788940552.495201:0:9941:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788940552.859465:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944805376:0@lo:13: 00000100:00100000:1.0:1788940552.859559:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940552.859758:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944805376 00000100:00100000:0.0:1788940552.859768:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944805376 00000100:00100000:0.0:1788940552.859823:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788940552.859832:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944805376:12345-0@lo:13: 00002000:00000024:0.0:1788940552.859863:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788940552.860740:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940552.860758:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940552.860775:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944805504:0@lo:13: 00000100:00100000:2.0:1788940552.860819:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940552.860854:0:8440:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788940552.860863:0:8440:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1788940552.860961:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944805504 00000100:00100000:2.0:1788940552.860974:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944805504 00000100:00080000:2.0:1788940552.861008:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940552.861100:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940552.861109:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944805504:12345-0@lo:13: 00002000:00000024:2.0:1788940552.861125:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940552.861160:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944805504:12345-0@lo:13: Request processed in 52us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940552.861167:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788940552.861202:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f39500 x1875839944805504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940552.861221:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944805504:0@lo:13: 00000100:00100000:0.0:1788940552.863871:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944805376:12345-0@lo:13: Request processed in 4030us (4302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940552.863887:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788940552.864203:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f39880 x1875839944805376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940552.864413:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944805376:0@lo:13: 00000001:00080000:1.0:1788940553.274837:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:0.0:1788940553.499607:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940553.883573:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944805632:0@lo:41: 00000100:00100000:2.0:1788940553.883652:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940553.884275:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944805632 00000100:00100000:0.0:1788940553.884284:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944805632 00000100:00100000:0.0:1788940553.884344:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788940553.884354:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944805632:12345-0@lo:41: 00000004:00000024:0.0:1788940553.884388:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788940553.884459:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944805632:12345-0@lo:41: Request processed in 107us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940553.884466:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788940553.884599:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944805632:0@lo:41: 00010000:00010000:2.0:1788940554.524082:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940554.907488:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944806016:0@lo:13: 00000100:00100000:3.0:1788940554.907577:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940554.907732:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944806016 00000100:00100000:2.0:1788940554.907741:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944806016 00000100:00100000:2.0:1788940554.907801:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940554.907812:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944806016:12345-0@lo:13: 00002000:00000024:2.0:1788940554.907845:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940554.914699:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944806144:0@lo:400: 00000100:00100000:1.0:1788940554.915124:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940554.915140:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944806528:0@lo:400: 00000100:00100000:1.0:1788940554.915173:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940554.915184:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944806272:0@lo:400: 00000100:00100000:3.0:1788940554.915196:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940554.915222:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940554.915289:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944806144 00000100:00100000:1.0:1788940554.915300:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944806144 00000100:00100000:1.0:1788940554.915353:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788940554.915362:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944806144:12345-0@lo:400: 00000100:00100000:1.0:1788940554.915418:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944806144:12345-0@lo:400: Request processed in 57us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940554.915425:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788940554.915458:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944806528 00000100:00100000:1.0:1788940554.915462:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944806528 00000100:00100000:1.0:1788940554.915813:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944806272 00000100:00100000:1.0:1788940554.915818:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944806272 00000100:00100000:1.0:1788940554.915831:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788940554.915854:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944806528:12345-0@lo:400: 00000100:00100000:1.0:1788940554.915890:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944806528:12345-0@lo:400: Request processed in 38us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940554.915896:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788940554.915907:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788940554.915913:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944806272:12345-0@lo:400: 00000100:00100000:1.0:1788940554.915938:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944806272:12345-0@lo:400: Request processed in 26us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940554.915943:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788940554.915987:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944806272:0@lo:400: 00010000:00080000:1.0:1788940554.916000:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ee0380 x1875839944806144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940554.916008:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944806144:0@lo:400: 00000100:00080000:1.0:1788940554.922650:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940554.925749:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944806784:0@lo:400: 00000100:00100000:1.0:1788940554.925843:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940554.925893:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944807296:0@lo:400: 00000100:00100000:1.0:1788940554.925911:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940554.925941:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788940554.925948:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944806656:0@lo:400: 00000100:00100000:1.0:1788940554.925967:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940554.925986:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839944807168:0@lo:400: 00000100:00100000:1.0:1788940554.926006:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940554.926045:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944806784 00000100:00100000:1.0:1788940554.926053:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944806784 00000100:00100000:1.0:1788940554.926117:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944807296 00000100:00100000:1.0:1788940554.926121:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944807296 00000100:00100000:1.0:1788940554.926134:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944806656 00000100:00100000:1.0:1788940554.926137:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944806656 00000100:00100000:0.0:1788940554.926270:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944807168 00000100:00100000:0.0:1788940554.926275:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944807168 00000100:00100000:1.0:1788940554.926327:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788940554.926336:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944806784:12345-0@lo:400: 00000100:00100000:1.0:1788940554.926390:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944806784:12345-0@lo:400: Request processed in 55us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940554.926397:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788940554.926412:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788940554.926418:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944807296:12345-0@lo:400: 00000100:00100000:1.0:1788940554.926443:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944807296:12345-0@lo:400: Request processed in 25us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940554.926449:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788940554.926458:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788940554.926573:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944806016:12345-0@lo:13: Request processed in 18762us (18994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940554.926582:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788940554.927167:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f39500 x1875839944806016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940554.927181:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788940554.927206:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944806016:0@lo:13: 00000100:00100000:3.0:1788940554.927229:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944807040:0@lo:400: 00000100:00100000:3.0:1788940554.927283:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940554.927369:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944806528:0@lo:400: 00000100:00100000:3.0:1788940554.927382:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [0->1] 00000100:00100000:3.0:1788940554.927389:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944805760:0@lo:13: 00000100:00100000:3.0:1788940554.927413:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940554.927436:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944805888:0@lo:400: 00000100:00100000:3.0:1788940554.927459:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940554.927491:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944806400:0@lo:400: 00000100:00100000:3.0:1788940554.927514:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940554.927528:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944806912:0@lo:400: 00000100:00100000:3.0:1788940554.927547:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940554.927666:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944806400 00000100:00100000:0.0:1788940554.927671:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944806400 00000100:00100000:0.0:1788940554.927685:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788940554.927692:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839944807168:12345-0@lo:400: 00000100:00100000:0.0:1788940554.927731:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839944807168:12345-0@lo:400: Request processed in 40us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940554.927737:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788940554.927751:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788940554.927757:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944806400:12345-0@lo:400: 00000100:00100000:0.0:1788940554.927780:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944806400:12345-0@lo:400: Request processed in 24us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940554.927786:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788940554.927804:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944805760 00000100:00100000:0.0:1788940554.927807:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944805760 00000100:00100000:0.0:1788940554.927833:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788940554.927839:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944805760:12345-0@lo:13: 00002000:00000024:0.0:1788940554.927853:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940554.927883:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944805760:12345-0@lo:13: Request processed in 44us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940554.927901:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788940554.928022:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944806656:12345-0@lo:400: 00000100:00100000:1.0:1788940554.928056:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944806656:12345-0@lo:400: Request processed in 1592us (2088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940554.928062:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788940554.928080:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944805888 00000100:00100000:1.0:1788940554.928083:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944805888 00000100:00100000:1.0:1788940554.928108:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788940554.928115:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944805888:12345-0@lo:400: 00000100:00100000:1.0:1788940554.928153:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944805888:12345-0@lo:400: Request processed in 28us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940554.928159:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:1.0:1788940554.928194:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940554.928203:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940554.928206:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788940554.928238:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ee0e00 x1875839944806656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940554.928250:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944806656:0@lo:400: 00010000:00080000:1.0:1788940554.928276:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ee3800 x1875839944807168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940554.928285:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839944807168:0@lo:400: 00010000:00080000:1.0:1788940554.928296:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ee0000 x1875839944806784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940554.928305:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944806784:0@lo:400: 00010000:00080000:1.0:1788940554.928315:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ee3b80 x1875839944807296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940554.928322:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944807296:0@lo:400: 00000100:00100000:3.0:1788940554.928540:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944807424:0@lo:400: 00000100:00100000:3.0:1788940554.928566:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940554.928610:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944807040 00000100:00100000:2.0:1788940554.928615:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944807040 00000100:00080000:1.0:1788940554.928675:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940554.928729:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944806912 00000100:00100000:0.0:1788940554.928733:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944806912 00000100:00100000:0.0:1788940554.928761:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940554.928767:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944807040:12345-0@lo:400: 00000100:00100000:0.0:1788940554.928801:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944807040:12345-0@lo:400: Request processed in 35us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940554.928807:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940554.928820:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940554.928826:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06102680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944806912:12345-0@lo:400: 00000100:00100000:0.0:1788940554.928848:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06102680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944806912:12345-0@lo:400: Request processed in 23us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940554.928854:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788940554.928898:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788940554.928953:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ee0380 x1875839944807040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940554.928976:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944807040:0@lo:400: 00010000:00080000:3.0:1788940554.928995:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d034758a80 x1875839944805760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940554.929003:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788940554.929017:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944805760:0@lo:13: 00000100:00100000:3.0:1788940554.929024:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944805888:0@lo:400: 00010000:00080000:3.0:1788940554.929034:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ee2a00 x1875839944806400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940554.929042:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944806400:0@lo:400: 00010000:00080000:3.0:1788940554.929050:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ee2680 x1875839944806912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940554.929057:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944806912:0@lo:400: 00000100:00100000:3.0:1788940554.929092:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944807424 00000100:00100000:3.0:1788940554.929096:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944807424 00000100:00100000:3.0:1788940554.929211:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788940554.929219:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06102d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944807424:12345-0@lo:400: 00000100:00100000:3.0:1788940554.929254:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06102d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944807424:12345-0@lo:400: Request processed in 37us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940554.929275:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788940554.929299:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ee2d80 x1875839944807424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940554.929307:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944807424:0@lo:400: 00000020:00000004:1.0:1788940555.388968:0:10043:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788940555.389206:0:10043:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788940555.547760:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940556.572610:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788940556.677632:0:10091:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788940556.677654:0:10091:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1788940557.319726:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940557.323006:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921684608 00000100:00100000:1.0:1788940557.323143:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921684608 00000100:00100000:0.0:1788940557.323772:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 184 00000100:00100000:0.0:1788940557.323782:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2403:x1875839921684608:12345-192.168.202.25@tcp:250: 00010000:00080000:0.0:1788940557.323813:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b9d4689c-491f-4d5c-b012-ebe6beb5c037@192.168.202.25@tcp t0 exp 0000000000000000 cur 312 last 0 00000020:00000080:0.0:1788940557.323845:0:6513:0:(genops.c:1393:class_connect()) connect: client b9d4689c-491f-4d5c-b012-ebe6beb5c037, cookie 0x9c34acc08badd108 00000100:00080000:0.0:1788940557.324020:0:6513:0:(import.c:65:import_set_state_nolock()) ffff91cf07a18800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940557.324117:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+5:2403:x1875839921684608:12345-192.168.202.25@tcp:250: Request processed in 335us (4400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940557.324125:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 184 00000100:00100000:3.0:1788940557.344537:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940557.344634:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921684736 00000100:00100000:0.0:1788940557.344644:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921684736 00000100:00100000:0.0:1788940557.344705:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 185 00000100:00100000:0.0:1788940557.344716:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+5:6177:x1875839921684736:12345-192.168.202.25@tcp:101: 00010000:00010000:0.0:1788940557.344752:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940557.344770:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584d000/0x9c34acc08badd10f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc70d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940557.344799:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584d000/0x9c34acc08badd10f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc70d8 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940557.344810:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584d000/0x9c34acc08badd10f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc70d8 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940557.344819:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584d000, rc 0) 00000100:00100000:0.0:1788940557.344883:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+6:6177:x1875839921684736:12345-192.168.202.25@tcp:101: Request processed in 168us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940557.344890:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 185 00000100:00100000:3.0:1788940557.353415:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940557.355155:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921684864 00000100:00100000:0.0:1788940557.355182:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921684864 00000100:00100000:0.0:1788940557.355304:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 186 00000100:00100000:0.0:1788940557.355317:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+6:6177:x1875839921684864:12345-192.168.202.25@tcp:501: 00000100:00100000:0.0:1788940557.355901:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+6:6177:x1875839921684864:12345-192.168.202.25@tcp:501: Request processed in 584us (2492us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940557.355910:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 186 00000100:00100000:3.0:1788940557.372201:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940557.372433:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921684992 00000100:00100000:1.0:1788940557.372444:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921684992 00000100:00100000:1.0:1788940557.372510:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 187 00000100:00100000:1.0:1788940557.372521:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+6:6177:x1875839921684992:12345-192.168.202.25@tcp:101: 00010000:00010000:1.0:1788940557.372538:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940557.372571:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badd116 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc70df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940557.372601:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badd116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc70df expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940557.372614:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badd116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc70df expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940557.372623:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaaae00, rc 0) 00000100:00100000:1.0:1788940557.372680:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+7:6177:x1875839921684992:12345-192.168.202.25@tcp:101: Request processed in 160us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940557.372688:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 187 00000100:00100000:2.0:1788940557.388501:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940557.388630:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921685120 00000100:00100000:3.0:1788940557.388641:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921685120 00000100:00100000:3.0:1788940557.388698:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 188 00000100:00100000:3.0:1788940557.388707:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+7:6177:x1875839921685120:12345-192.168.202.25@tcp:501: 00000100:00100000:3.0:1788940557.388860:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+8:6177:x1875839921685120:12345-192.168.202.25@tcp:501: Request processed in 154us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940557.388867:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 188 00000100:00100000:3.0:1788940557.395379:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940557.395448:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921685248 00000100:00100000:0.0:1788940557.395486:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921685248 00000100:00100000:0.0:1788940557.395548:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 189 00000100:00100000:0.0:1788940557.395558:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+8:6177:x1875839921685248:12345-192.168.202.25@tcp:503: 00000100:00100000:0.0:1788940557.395718:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+8:6177:x1875839921685248:12345-192.168.202.25@tcp:503: Request processed in 161us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940557.395736:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 189 00000100:00100000:2.0:1788940557.411225:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940557.411814:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921685376 00000100:00100000:1.0:1788940557.411827:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921685376 00000100:00100000:1.0:1788940557.411890:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 190 00000100:00100000:1.0:1788940557.411900:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+8:6197:x1875839921685376:12345-192.168.202.25@tcp:502: 00000100:00100000:1.0:1788940557.412213:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+8:6197:x1875839921685376:12345-192.168.202.25@tcp:502: Request processed in 312us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940557.412221:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 190 00000100:00100000:3.0:1788940557.468018:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944807552:0@lo:41: 00000100:00100000:3.0:1788940557.468177:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940557.468295:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944807552 00000100:00100000:1.0:1788940557.468304:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944807552 00000100:00100000:1.0:1788940557.468346:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788940557.468355:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944807552:12345-0@lo:41: 00000004:00000024:1.0:1788940557.468399:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788940557.468444:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944807552:12345-0@lo:41: Request processed in 89us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940557.468460:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788940557.468639:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944807552:0@lo:41: 00000100:00100000:2.0:1788940557.469097:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940557.469285:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921685504 00000100:00100000:3.0:1788940557.469290:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921685504 00000100:00100000:3.0:1788940557.469327:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 191 00000100:00100000:3.0:1788940557.469335:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+8:6197:x1875839921685504:12345-192.168.202.25@tcp:502: 00000100:00100000:3.0:1788940557.469473:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+8:6197:x1875839921685504:12345-192.168.202.25@tcp:502: Request processed in 138us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940557.469481:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 191 00000100:00100000:0.0:1788940557.480202:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940557.480303:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921685632 00000100:00100000:1.0:1788940557.480323:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921685632 00000100:00100000:1.0:1788940557.480380:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 192 00000100:00100000:1.0:1788940557.480401:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+8:6177:x1875839921685632:12345-192.168.202.25@tcp:101: 00010000:00010000:1.0:1788940557.480420:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940557.480437:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaaba00/0x9c34acc08badd11d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7110 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940557.480474:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaaba00/0x9c34acc08badd11d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7110 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940557.480488:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaaba00/0x9c34acc08badd11d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7110 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940557.480497:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaaba00, rc 0) 00000100:00100000:1.0:1788940557.480565:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+9:6177:x1875839921685632:12345-192.168.202.25@tcp:101: Request processed in 176us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940557.480572:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 192 00000100:00100000:0.0:1788940557.493352:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940557.494279:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921685760 00000100:00100000:3.0:1788940557.494291:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921685760 00000100:00100000:3.0:1788940557.494363:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 193 00000100:00100000:3.0:1788940557.494374:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+9:6177:x1875839921685760:12345-192.168.202.25@tcp:256: 20000000:01000000:3.0:1788940557.494423:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788940557.494441:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788940557.494444:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788940557.494447:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788940557.494459:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788940557.494462:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788940557.503013:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+9:6177:x1875839921685760:12345-192.168.202.25@tcp:256: Request processed in 8628us (9659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940557.503030:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 193 00000100:00100000:0.0:1788940557.507759:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940557.507905:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921685888 00000100:00100000:3.0:1788940557.507916:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921685888 00000100:00100000:3.0:1788940557.507977:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 194 00000100:00100000:3.0:1788940557.507989:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+9:6177:x1875839921685888:12345-192.168.202.25@tcp:101: 00010000:00010000:3.0:1788940557.508006:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940557.508022:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd124 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7117 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940557.508054:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd124 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7117 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940557.508066:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd124 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7117 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940557.508076:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0421c0e00, rc 0) 00000100:00100000:3.0:1788940557.508144:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6177:x1875839921685888:12345-192.168.202.25@tcp:101: Request processed in 157us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940557.508152:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 194 00000100:00100000:0.0:1788940557.510495:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940557.520213:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921686016 00000100:00100000:3.0:1788940557.520245:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921686016 00000100:00100000:3.0:1788940557.520429:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 195 00000100:00100000:3.0:1788940557.520441:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6177:x1875839921686016:12345-192.168.202.25@tcp:501: 00000100:00100000:3.0:1788940557.520620:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6177:x1875839921686016:12345-192.168.202.25@tcp:501: Request processed in 181us (10131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940557.520629:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 195 00000100:00100000:0.0:1788940557.524340:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940557.524501:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921686144 00000100:00100000:1.0:1788940557.524511:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921686144 00000100:00100000:1.0:1788940557.524562:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 196 00000100:00100000:1.0:1788940557.524571:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6177:x1875839921686144:12345-192.168.202.25@tcp:503: 00000100:00100000:1.0:1788940557.524735:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6177:x1875839921686144:12345-192.168.202.25@tcp:503: Request processed in 164us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940557.524742:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 196 00000100:00100000:2.0:1788940557.528780:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940557.529033:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921686272 00000100:00100000:3.0:1788940557.529046:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921686272 00000100:00100000:3.0:1788940557.529112:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 197 00000100:00100000:3.0:1788940557.529123:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6203:x1875839921686272:12345-192.168.202.25@tcp:502: 00000100:00100000:3.0:1788940557.529319:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6203:x1875839921686272:12345-192.168.202.25@tcp:502: Request processed in 196us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940557.529328:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 197 00000100:00100000:2.0:1788940557.535520:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940557.535631:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921686400 00000100:00100000:0.0:1788940557.535643:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921686400 00000100:00100000:0.0:1788940557.535706:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 198 00000100:00100000:0.0:1788940557.535715:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6203:x1875839921686400:12345-192.168.202.25@tcp:502: 00000100:00100000:0.0:1788940557.535893:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6203:x1875839921686400:12345-192.168.202.25@tcp:502: Request processed in 178us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940557.535901:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 198 00000100:00100000:0.0:1788940557.543092:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940557.543134:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940557.543337:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921686528 00000100:00100000:2.0:1788940557.543347:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921686528 00000100:00100000:2.0:1788940557.543391:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921686784 00000100:00100000:2.0:1788940557.543394:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921686784 00000100:00100000:2.0:1788940557.543426:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:2.0:1788940557.543436:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875839921686528:12345-192.168.202.25@tcp:38: 00010000:00080000:2.0:1788940557.543482:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp t0 exp 0000000000000000 cur 312 last 0 00000100:00100000:3.0:1788940557.543485:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:3.0:1788940557.543501:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875839921686784:12345-192.168.202.25@tcp:38: 00010000:00080000:3.0:1788940557.543541:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp t0 exp 0000000000000000 cur 312 last 0 00000020:00000080:2.0:1788940557.543550:0:6522:0:(genops.c:1393:class_connect()) connect: client 82f3b232-46da-4a78-8599-45df2ddbced0, cookie 0x9c34acc08badd12b 00000004:00100000:2.0:1788940557.543582:0:6522:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000020:00000080:3.0:1788940557.543617:0:6520:0:(genops.c:1393:class_connect()) connect: client 82f3b232-46da-4a78-8599-45df2ddbced0, cookie 0x9c34acc08badd132 00000004:00100000:3.0:1788940557.543645:0:6520:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:2.0:1788940557.543904:0:6522:0:(import.c:65:import_set_state_nolock()) ffff91cf01ac7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940557.544161:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:2403:x1875839921686528:12345-192.168.202.25@tcp:38: Request processed in 541us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940557.544172:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00080000:3.0:1788940557.548917:0:6520:0:(import.c:65:import_set_state_nolock()) ffff91cf08456800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940557.549044:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2403:x1875839921686784:12345-192.168.202.25@tcp:38: Request processed in 5544us (5905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940557.549058:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 8 00010000:00010000:0.0:1788940557.595494:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940557.979880:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940557.979921:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944807680:0@lo:13: 00000100:00100000:3.0:1788940557.980032:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940557.980282:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944807680 00000100:00100000:2.0:1788940557.980295:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944807680 00000100:00100000:2.0:1788940557.980381:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788940557.980394:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944807680:12345-0@lo:13: 00002000:00000024:2.0:1788940557.980434:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940557.980508:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944807680:12345-0@lo:13: Request processed in 117us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940557.980517:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788940557.980591:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788940557.980672:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f38e00 x1875839944807680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940557.980695:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944807680:0@lo:13: 00000100:00100000:1.0:1788940557.981377:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940557.981393:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944807808:0@lo:13: 00000100:00100000:1.0:1788940557.981478:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940557.981630:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944807808 00000100:00100000:2.0:1788940557.981637:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944807808 00000100:00100000:2.0:1788940557.981753:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788940557.981763:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944807808:12345-0@lo:13: 00002000:00000024:2.0:1788940557.981781:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940557.981849:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944807808:12345-0@lo:13: Request processed in 87us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940557.981856:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788940557.986727:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f38e00 x1875839944807808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940557.986762:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944807808:0@lo:13: 00000100:00080000:0.0:1788940557.992967:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940558.301844:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940558.305975:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921687040 00000100:00100000:2.0:1788940558.305997:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921687040 00000100:00100000:2.0:1788940558.306120:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:2.0:1788940558.306133:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:6177:x1875839921687040:12345-192.168.202.25@tcp:41: 00000004:00000024:2.0:1788940558.306188:0:8517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:1.0:1788940558.306361:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940558.310906:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:6177:x1875839921687040:12345-192.168.202.25@tcp:41: Request processed in 4756us (9061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940558.310928:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:0.0:1788940558.311390:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940558.312034:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940558.312616:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921686656 00000100:00100000:1.0:1788940558.312631:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921686656 00000100:00100000:1.0:1788940558.312703:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921686912 00000100:00100000:1.0:1788940558.312708:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921686912 00000100:00100000:1.0:1788940558.312754:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:1.0:1788940558.312765:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+6:0:x1875839921686656:12345-192.168.202.25@tcp:41: 00000100:00100000:3.0:1788940558.312955:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00100000:3.0:1788940558.312966:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:0:x1875839921686912:12345-192.168.202.25@tcp:41: 00000004:00000024:3.0:1788940558.312997:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00080000:0.0:1788940558.313095:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788940558.313431:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:0:x1875839921686912:12345-192.168.202.25@tcp:41: Request processed in 466us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940558.313449:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00100000:3.0:1788940558.313510:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940558.313757:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921687168 00000100:00100000:3.0:1788940558.313764:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921687168 00000100:00100000:3.0:1788940558.313794:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:3.0:1788940558.313810:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+7:6177:x1875839921687168:12345-192.168.202.25@tcp:40: 00000100:00100000:3.0:1788940558.313852:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+7:6177:x1875839921687168:12345-192.168.202.25@tcp:40: Request processed in 52us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940558.313859:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 12 00000004:00000024:1.0:1788940558.314331:0:9713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788940558.314379:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+6:0:x1875839921686656:12345-192.168.202.25@tcp:41: Request processed in 1614us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940558.314387:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:0.0:1788940558.317712:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940558.317769:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940558.317900:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940558.317928:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940558.317965:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921687296 00000100:00100000:0.0:1788940558.317996:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921687296 00000100:00100000:0.0:1788940558.318055:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921687424 00000100:00100000:0.0:1788940558.318058:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921687424 00000100:00100000:0.0:1788940558.318082:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:0.0:1788940558.318093:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1875839921687296:12345-192.168.202.25@tcp:8: 00010000:00080000:0.0:1788940558.318139:0:8437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:0.0:1788940558.318313:0:8437:0:(genops.c:1393:class_connect()) connect: client 82f3b232-46da-4a78-8599-45df2ddbced0, cookie 0x9c34acc08badd139 00002000:00100000:0.0:1788940558.318329:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 82f3b232-46da-4a78-8599-45df2ddbced0/ffff91cf07a1a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788940558.318342:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1788940558.318607:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788940558.318647:0:8437:0:(import.c:65:import_set_state_nolock()) ffff91cf07a19800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940558.318726:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2403:x1875839921687296:12345-192.168.202.25@tcp:8: Request processed in 633us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940558.318735:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:0.0:1788940558.318756:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:0.0:1788940558.318761:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1875839921687424:12345-192.168.202.25@tcp:8: 00010000:00080000:0.0:1788940558.318779:0:8437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:0.0:1788940558.318796:0:8437:0:(genops.c:1393:class_connect()) connect: client 82f3b232-46da-4a78-8599-45df2ddbced0, cookie 0x9c34acc08badd140 00000100:00100000:2.0:1788940558.318982:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921687552 00000100:00100000:2.0:1788940558.318989:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921687552 00000100:00100000:2.0:1788940558.319045:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:2.0:1788940558.319053:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:82f3b232-46da-4a78-8599-45df2ddbced0+6:6177:x1875839921687552:12345-192.168.202.25@tcp:900: 00000100:00100000:2.0:1788940558.319192:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:82f3b232-46da-4a78-8599-45df2ddbced0+6:6177:x1875839921687552:12345-192.168.202.25@tcp:900: Request processed in 140us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940558.319200:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 4 00002000:00100000:0.0:1788940558.320056:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 82f3b232-46da-4a78-8599-45df2ddbced0/ffff91cf07a1b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788940558.320081:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1788940558.320756:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788940558.320875:0:8437:0:(import.c:65:import_set_state_nolock()) ffff91cf07a1c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940558.320977:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2403:x1875839921687424:12345-192.168.202.25@tcp:8: Request processed in 2212us (3046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940558.320988:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:0.0:1788940558.327390:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940558.327976:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921687808 00000100:00100000:2.0:1788940558.327990:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921687808 00000100:00100000:2.0:1788940558.328077:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:2.0:1788940558.328089:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:6177:x1875839921687808:12345-192.168.202.25@tcp:33: 00000100:00100000:3.0:1788940558.328836:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921687680 00000100:00100000:3.0:1788940558.328845:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921687680 00000100:00100000:3.0:1788940558.328895:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 199 00000100:00100000:3.0:1788940558.328903:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2405:x1875839921687680:12345-192.168.202.25@tcp:400: 00000100:00100000:3.0:1788940558.328996:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2405:x1875839921687680:12345-192.168.202.25@tcp:400: Request processed in 93us (11225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940558.329013:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 199 00000004:00080000:3.0:1788940558.361629:0:6523:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 33425us 00000004:00200000:2.0:1788940558.380785:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788940558.380928:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:6177:x1875839921687808:12345-192.168.202.25@tcp:33: Request processed in 52835us (53547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940558.380940:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:0.0:1788940558.580074:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940558.580196:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921687936 00000100:00100000:3.0:1788940558.580211:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921687936 00000100:00100000:3.0:1788940558.580341:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:3.0:1788940558.580354:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:6221:x1875839921687936:12345-192.168.202.25@tcp:101: 00010000:00010000:3.0:1788940558.580386:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940558.580705:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08badd147 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7148 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940558.580801:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badd14e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940558.580817:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badd14e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940558.580833:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badd14e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940558.580888:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788940558.580893:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940558.580910:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badd14e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940558.580941:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08badd147 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7148 expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940558.580963:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badd14e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7148 expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940558.580972:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d0207af200) 00010000:00010000:3.0:1788940558.580975:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940558.580993:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f6400, rc 0) 00000100:00100000:3.0:1788940558.581075:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+7:6221:x1875839921687936:12345-192.168.202.25@tcp:101: Request processed in 723us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940558.581085:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 13 00010000:00010000:1.0:1788940558.619520:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940559.004446:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944807936:0@lo:41: 00000100:00100000:3.0:1788940559.004544:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940559.004627:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944807936 00000100:00100000:2.0:1788940559.004638:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944807936 00000100:00100000:2.0:1788940559.004690:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788940559.004700:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944807936:12345-0@lo:41: 00000004:00000024:2.0:1788940559.004755:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940559.004816:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944807936:12345-0@lo:41: Request processed in 118us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940559.004823:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788940559.004870:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944807936:0@lo:41: 00010000:00010000:0.0:1788940559.643899:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940560.028193:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944808192:0@lo:400: 00000100:00100000:1.0:1788940560.028297:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940560.028298:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944808448:0@lo:400: 00000100:00100000:0.0:1788940560.028332:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940560.028360:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944808704:0@lo:400: 00000100:00100000:0.0:1788940560.028360:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944808960:0@lo:400: 00000100:00100000:1.0:1788940560.028381:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940560.028382:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940560.028396:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944809216:0@lo:400: 00000100:00100000:0.0:1788940560.028396:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944809472:0@lo:400: 00000100:00100000:0.0:1788940560.028413:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940560.028414:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940560.028448:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788940560.028454:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944808064:0@lo:400: 00000100:00100000:0.0:1788940560.028484:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940560.028508:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944808576:0@lo:400: 00000100:00100000:0.0:1788940560.028533:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940560.028552:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944809088:0@lo:400: 00000100:00100000:0.0:1788940560.028573:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940560.028590:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944809600:0@lo:400: 00000100:00100000:0.0:1788940560.028641:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940560.028652:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944808192 00000100:00100000:2.0:1788940560.028660:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944808192 00000100:00100000:0.0:1788940560.028668:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944808448 00000100:00100000:0.0:1788940560.028671:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944808448 00000100:00100000:2.0:1788940560.028719:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944808704 00000100:00100000:2.0:1788940560.028723:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944808704 00000100:00100000:3.0:1788940560.028788:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944808320:0@lo:400: 00000100:00100000:1.0:1788940560.028797:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944808064 00000100:00100000:1.0:1788940560.028803:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944808064 00000100:00100000:3.0:1788940560.028831:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940560.028848:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788940560.028860:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944808832:0@lo:400: 00000100:00100000:1.0:1788940560.028862:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944808064:12345-0@lo:400: 00000100:00100000:3.0:1788940560.028903:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940560.028921:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944809344:0@lo:400: 00000100:00100000:1.0:1788940560.028929:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944808064:12345-0@lo:400: Request processed in 70us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940560.028946:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788940560.028952:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940560.029001:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944808960 00000100:00100000:1.0:1788940560.029005:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944808960 00000100:00100000:1.0:1788940560.029038:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944809472 00000100:00100000:1.0:1788940560.029041:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944809472 00000100:00100000:3.0:1788940560.029047:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944809856:0@lo:13: 00000100:00100000:1.0:1788940560.029054:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944809088 00000100:00100000:1.0:1788940560.029058:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944809088 00000100:00100000:1.0:1788940560.029075:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944809600 00000100:00100000:1.0:1788940560.029078:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944809600 00000100:00100000:1.0:1788940560.029094:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788940560.029100:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944808960:12345-0@lo:400: 00000100:00100000:1.0:1788940560.029135:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944808960:12345-0@lo:400: Request processed in 36us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940560.029141:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788940560.029151:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940560.029156:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944809472:12345-0@lo:400: 00000100:00100000:1.0:1788940560.029181:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944809472:12345-0@lo:400: Request processed in 25us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940560.029187:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940560.029198:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788940560.029203:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944809088:12345-0@lo:400: 00000100:00100000:1.0:1788940560.029228:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944809088:12345-0@lo:400: Request processed in 25us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940560.029233:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788940560.029243:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788940560.029249:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944809600:12345-0@lo:400: 00000100:00100000:1.0:1788940560.029294:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944809600:12345-0@lo:400: Request processed in 46us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940560.029306:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788940560.029324:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944808576 00000100:00100000:1.0:1788940560.029328:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944808576 00000100:00100000:1.0:1788940560.029347:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944808320 00000100:00100000:1.0:1788940560.029350:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944808320 00000100:00100000:3.0:1788940560.029390:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940560.029416:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940560.029422:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944809728:0@lo:13: 00000100:00100000:3.0:1788940560.029455:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940560.029480:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944809856 00000100:00100000:3.0:1788940560.029484:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944809856 00000100:00100000:3.0:1788940560.029506:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944809728 00000100:00100000:3.0:1788940560.029521:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944809728 00000100:00100000:3.0:1788940560.029535:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788940560.029541:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944809856:12345-0@lo:13: 00002000:00000024:3.0:1788940560.029565:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940560.029601:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944809856:12345-0@lo:13: Request processed in 60us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940560.029613:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788940560.029627:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788940560.029632:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944809728:12345-0@lo:13: 00002000:00000024:3.0:1788940560.029641:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940560.029667:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944809728:12345-0@lo:13: Request processed in 35us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940560.029673:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788940560.029698:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788940560.029706:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944808576:12345-0@lo:400: 00000100:00100000:3.0:1788940560.031231:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944808576:12345-0@lo:400: Request processed in 1520us (2690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940560.031243:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1788940560.031332:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0359d6d80 x1875839944809728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940560.031354:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944809728:0@lo:13: 00010000:00080000:3.0:1788940560.031368:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0359d5880 x1875839944809856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940560.031381:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944809856:0@lo:13: 00000100:00100000:3.0:1788940560.031419:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944809216 00000100:00100000:3.0:1788940560.031424:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944809216 00000100:00100000:0.0:1788940560.034487:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944808832 00000100:00100000:0.0:1788940560.034502:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944808832 00000100:00100000:0.0:1788940560.034523:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944809344 00000100:00100000:0.0:1788940560.034525:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944809344 00000100:00100000:0.0:1788940560.034545:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788940560.034557:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944808192:12345-0@lo:400: 00000100:00100000:0.0:1788940560.034674:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944808192:12345-0@lo:400: Request processed in 120us (6377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940560.034708:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788940560.034730:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788940560.034736:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944808448:12345-0@lo:400: 00000100:00100000:0.0:1788940560.034771:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944808448:12345-0@lo:400: Request processed in 35us (6438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940560.034777:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788940560.034791:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788940560.034799:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944808832:12345-0@lo:400: 00000100:00100000:0.0:1788940560.034835:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944808832:12345-0@lo:400: Request processed in 39us (5933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940560.034841:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788940560.034852:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788940560.034857:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944809344:12345-0@lo:400: 00000100:00100000:0.0:1788940560.034885:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944809344:12345-0@lo:400: Request processed in 28us (5934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940560.034890:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1788940560.034922:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788940560.034928:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940560.034931:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940560.034971:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944808192:0@lo:400: 00010000:00080000:0.0:1788940560.035009:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a50a80 x1875839944808832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940560.035021:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944808832:0@lo:400: 00010000:00080000:0.0:1788940560.035032:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a52300 x1875839944809344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940560.035053:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944809344:0@lo:400: 00000100:00100000:0.0:1788940560.035084:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944808064:0@lo:400: 00000100:00100000:0.0:1788940560.035097:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944808576:0@lo:400: 00010000:00080000:0.0:1788940560.035108:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a50000 x1875839944809088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940560.035116:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944809088:0@lo:400: 00010000:00080000:0.0:1788940560.035127:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a50700 x1875839944809600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940560.035135:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944809600:0@lo:400: 00000100:00100000:0.0:1788940560.035146:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944808448:0@lo:400: 00010000:00080000:0.0:1788940560.035157:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a50e00 x1875839944808960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940560.035165:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944808960:0@lo:400: 00010000:00080000:0.0:1788940560.035177:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a53100 x1875839944809472/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940560.035184:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944809472:0@lo:400: 00000100:00100000:2.0:1788940560.039225:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788940560.039246:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944808704:12345-0@lo:400: 00000100:00100000:2.0:1788940560.039376:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944808704:12345-0@lo:400: Request processed in 138us (10993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940560.039383:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788940560.039461:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944808704:0@lo:400: 00000100:00080000:0.0:1788940560.040417:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940560.049026:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788940560.049041:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944808320:12345-0@lo:400: 00000100:00100000:1.0:1788940560.049153:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944808320:12345-0@lo:400: Request processed in 114us (20321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940560.049414:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944808320:0@lo:400: 00000100:00100000:1.0:1788940560.050013:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1788940560.057313:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940560.058407:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788940560.058438:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944809216:12345-0@lo:400: 00000100:00100000:1.0:1788940560.058687:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944809216:12345-0@lo:400: Request processed in 269us (30271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940560.058695:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788940560.058774:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944809216:0@lo:400: 00010000:00010000:1.0:1788940560.667915:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940560.798255:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940560.798455:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921688064 00000100:00100000:0.0:1788940560.798468:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921688064 00000100:00100000:0.0:1788940560.798587:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:0.0:1788940560.798598:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+7:6273:x1875839921688064:12345-192.168.202.25@tcp:41: 00000004:00000024:0.0:1788940560.798663:0:8517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788940560.798755:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+7:6273:x1875839921688064:12345-192.168.202.25@tcp:41: Request processed in 158us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940560.798762:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00080000:2.0:1788940560.799294:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940560.803929:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940560.804313:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921688192 00000100:00100000:0.0:1788940560.804324:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921688192 00000100:00100000:0.0:1788940560.804400:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:0.0:1788940560.804412:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+6:6273:x1875839921688192:12345-192.168.202.25@tcp:41: 00000004:00000024:0.0:1788940560.804468:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788940560.804548:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+6:6273:x1875839921688192:12345-192.168.202.25@tcp:41: Request processed in 137us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940560.804555:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00080000:2.0:1788940560.805161:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788940560.808921:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940560.809203:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921688320 00000100:00100000:3.0:1788940560.809215:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921688320 00000100:00100000:3.0:1788940560.809329:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:3.0:1788940560.809341:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:82f3b232-46da-4a78-8599-45df2ddbced0+6:6273:x1875839921688320:12345-192.168.202.25@tcp:13: 00002000:00000024:3.0:1788940560.809380:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788940560.809672:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940560.809765:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:82f3b232-46da-4a78-8599-45df2ddbced0+6:6273:x1875839921688320:12345-192.168.202.25@tcp:13: Request processed in 425us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940560.809775:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:1.0:1788940560.814009:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940560.815730:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921688448 00000100:00100000:3.0:1788940560.815745:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921688448 00000100:00100000:3.0:1788940560.815838:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:3.0:1788940560.815850:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:82f3b232-46da-4a78-8599-45df2ddbced0+6:6273:x1875839921688448:12345-192.168.202.25@tcp:13: 00002000:00000024:3.0:1788940560.815878:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940560.815957:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:82f3b232-46da-4a78-8599-45df2ddbced0+6:6273:x1875839921688448:12345-192.168.202.25@tcp:13: Request processed in 109us (1964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940560.815965:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00080000:2.0:1788940560.816826:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788940561.691556:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940562.588924:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944809984:0@lo:41: 00000100:00100000:0.0:1788940562.589011:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940562.589588:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944809984 00000100:00100000:1.0:1788940562.589599:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944809984 00000100:00100000:1.0:1788940562.589694:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788940562.589704:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944809984:12345-0@lo:41: 00000004:00000024:1.0:1788940562.589738:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788940562.589797:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944809984:12345-0@lo:41: Request processed in 95us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940562.589804:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788940562.589893:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944809984:0@lo:41: 00000001:00100000:3.0:1788940562.593853:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 82f3b232-46da-4a78-8599-45df2ddbced0 00010000:00010000:1.0:1788940562.717813:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940563.101718:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944810112:0@lo:13: 00000100:00100000:2.0:1788940563.101769:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944810240:0@lo:13: 00000100:00100000:1.0:1788940563.101838:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940563.101892:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940563.101980:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944810112 00000100:00100000:3.0:1788940563.101992:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944810112 00000100:00100000:3.0:1788940563.102086:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944810240 00000100:00100000:3.0:1788940563.102091:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944810240 00000100:00100000:3.0:1788940563.102111:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788940563.102121:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944810112:12345-0@lo:13: 00002000:00000024:3.0:1788940563.102162:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788940563.102571:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940563.103017:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944810112:12345-0@lo:13: Request processed in 894us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940563.103028:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788940563.103054:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f38e00 x1875839944810112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940563.103061:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788940563.103071:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944810240:12345-0@lo:13: 00000100:00100000:1.0:1788940563.103079:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944810112:0@lo:13: 00002000:00000024:3.0:1788940563.103086:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940563.103131:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944810240:12345-0@lo:13: Request processed in 63us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940563.103157:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788940563.103235:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f70700 x1875839944810240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940563.103280:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944810240:0@lo:13: 00000001:00100000:3.0:1788940563.620473:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 82f3b232-46da-4a78-8599-45df2ddbced0 00000001:00100000:1.0:1788940563.632427:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 82f3b232-46da-4a78-8599-45df2ddbced0 00000001:00100000:1.0:1788940563.642715:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 82f3b232-46da-4a78-8599-45df2ddbced0 00000001:02000400:1.0:1788940563.715835:0:10189:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788940563.742735:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940563.749910:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940563.749952:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940563.749992:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940563.750015:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940563.750040:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940563.750067:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921689088 00000100:00100000:2.0:1788940563.750077:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921689088 00000100:00100000:2.0:1788940563.750140:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921688960 00000100:00100000:2.0:1788940563.750143:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921688960 00000100:00100000:2.0:1788940563.751631:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:2.0:1788940563.751646:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921689088:12345-192.168.202.25@tcp:400: 00000100:00100000:2.0:1788940563.751741:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921689088:12345-192.168.202.25@tcp:400: Request processed in 98us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940563.751749:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:2.0:1788940563.751770:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:2.0:1788940563.751777:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921688960:12345-192.168.202.25@tcp:400: 00000100:00100000:2.0:1788940563.751803:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921688960:12345-192.168.202.25@tcp:400: Request processed in 27us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940563.751809:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:2.0:1788940563.751837:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921688832 00000100:00100000:2.0:1788940563.751843:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921688832 00000100:00100000:2.0:1788940563.751876:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921688704 00000100:00100000:2.0:1788940563.751879:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921688704 00000100:00100000:2.0:1788940563.751900:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:2.0:1788940563.751907:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921688832:12345-192.168.202.25@tcp:400: 00000100:00100000:2.0:1788940563.751958:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921688832:12345-192.168.202.25@tcp:400: Request processed in 51us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940563.751965:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:2.0:1788940563.751978:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:2.0:1788940563.751985:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921688704:12345-192.168.202.25@tcp:400: 00000100:00100000:2.0:1788940563.752007:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921688704:12345-192.168.202.25@tcp:400: Request processed in 24us (1992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940563.752014:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00080000:2.0:1788940563.752038:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940563.752043:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940563.752045:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940563.752047:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940563.752382:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921688576 00000100:00100000:1.0:1788940563.752388:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921688576 00000100:00100000:1.0:1788940563.752437:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 201 00000100:00100000:1.0:1788940563.752444:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2404:x1875839921688576:12345-192.168.202.25@tcp:400: 00000100:00100000:1.0:1788940563.752479:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2404:x1875839921688576:12345-192.168.202.25@tcp:400: Request processed in 35us (2581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940563.752486:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 201 00000100:00100000:2.0:1788940564.123740:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944810368:0@lo:41: 00000100:00100000:2.0:1788940564.123829:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940564.123879:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944810368 00000100:00100000:1.0:1788940564.123888:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944810368 00000100:00100000:1.0:1788940564.123936:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788940564.123946:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944810368:12345-0@lo:41: 00000004:00000024:1.0:1788940564.123984:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788940564.129038:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944810368:12345-0@lo:41: Request processed in 5079us (5194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940564.129059:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788940564.132702:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944810368:0@lo:41: 00010000:00010000:3.0:1788940564.763685:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940565.147647:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944810624:0@lo:400: 00000100:00100000:0.0:1788940565.147756:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940565.147822:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944811136:0@lo:400: 00000100:00100000:0.0:1788940565.147846:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940565.147871:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944811648:0@lo:400: 00000100:00100000:0.0:1788940565.147893:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940565.147947:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788940565.147953:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944810496:0@lo:400: 00000100:00100000:0.0:1788940565.148004:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940565.148027:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944811008:0@lo:400: 00000100:00100000:0.0:1788940565.148074:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940565.148098:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944811520:0@lo:400: 00000100:00100000:0.0:1788940565.148124:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940565.148143:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944812032:0@lo:400: 00000100:00100000:0.0:1788940565.148164:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940565.148192:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944810752:0@lo:400: 00000100:00100000:0.0:1788940565.148215:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940565.148232:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944811264:0@lo:400: 00000100:00100000:0.0:1788940565.148251:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940565.148316:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944811776:0@lo:400: 00000100:00100000:0.0:1788940565.148339:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940565.148358:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788940565.148364:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944810880:0@lo:400: 00000100:00100000:0.0:1788940565.148398:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940565.148409:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944811392:0@lo:400: 00000100:00100000:0.0:1788940565.148428:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940565.148444:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944811904:0@lo:400: 00000100:00100000:0.0:1788940565.148462:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940565.148497:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944810624 00000100:00100000:0.0:1788940565.148506:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944810624 00000100:00100000:0.0:1788940565.148554:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944811136 00000100:00100000:0.0:1788940565.148557:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944811136 00000100:00100000:0.0:1788940565.148588:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944811648 00000100:00100000:0.0:1788940565.148591:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944811648 00000100:00100000:0.0:1788940565.148603:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944811264 00000100:00100000:0.0:1788940565.148606:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944811264 00000100:00100000:0.0:1788940565.148617:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944811776 00000100:00100000:0.0:1788940565.148619:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944811776 00000100:00100000:0.0:1788940565.148630:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944810880 00000100:00100000:0.0:1788940565.148633:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944810880 00000100:00100000:0.0:1788940565.148647:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788940565.148656:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944810624:12345-0@lo:400: 00000100:00100000:0.0:1788940565.148714:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944810624:12345-0@lo:400: Request processed in 58us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940565.148722:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788940565.148741:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788940565.148747:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944811136:12345-0@lo:400: 00000100:00100000:0.0:1788940565.148772:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944811136:12345-0@lo:400: Request processed in 25us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940565.148778:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788940565.148788:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788940565.148794:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944811648:12345-0@lo:400: 00000100:00100000:0.0:1788940565.148817:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944811648:12345-0@lo:400: Request processed in 24us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940565.148823:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788940565.148833:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788940565.148839:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944811264:12345-0@lo:400: 00000100:00100000:0.0:1788940565.148866:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944811264:12345-0@lo:400: Request processed in 27us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940565.148872:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788940565.148889:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788940565.148895:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944811776:12345-0@lo:400: 00000100:00100000:0.0:1788940565.148921:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944811776:12345-0@lo:400: Request processed in 26us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940565.148927:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788940565.148937:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788940565.148943:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944810880:12345-0@lo:400: 00000100:00100000:0.0:1788940565.148967:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944810880:12345-0@lo:400: Request processed in 24us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940565.148971:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788940565.148999:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944810496 00000100:00100000:0.0:1788940565.149003:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944810496 00000100:00100000:0.0:1788940565.149030:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788940565.149036:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944810496:12345-0@lo:400: 00000100:00100000:0.0:1788940565.149064:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944810496:12345-0@lo:400: Request processed in 28us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940565.149070:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788940565.149099:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944811008 00000100:00100000:0.0:1788940565.149103:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944811008 00000100:00100000:0.0:1788940565.149126:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944810752 00000100:00100000:0.0:1788940565.149129:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944810752 00000100:00100000:0.0:1788940565.149140:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788940565.149145:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944811008:12345-0@lo:400: 00000100:00100000:0.0:1788940565.149177:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944811008:12345-0@lo:400: Request processed in 30us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940565.149182:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788940565.149193:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788940565.149205:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944810752:12345-0@lo:400: 00000100:00100000:0.0:1788940565.149232:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944810752:12345-0@lo:400: Request processed in 28us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940565.149238:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788940565.149282:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944811520 00000100:00100000:0.0:1788940565.149286:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944811520 00000100:00100000:0.0:1788940565.149306:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944812032 00000100:00100000:0.0:1788940565.149309:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944812032 00000100:00100000:0.0:1788940565.149320:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944811392 00000100:00100000:0.0:1788940565.149323:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944811392 00000100:00100000:0.0:1788940565.149332:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944811904 00000100:00100000:0.0:1788940565.149335:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944811904 00000100:00100000:0.0:1788940565.149347:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788940565.149354:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944811520:12345-0@lo:400: 00000100:00100000:0.0:1788940565.149418:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944811520:12345-0@lo:400: Request processed in 65us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940565.149424:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788940565.149435:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788940565.149441:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944812032:12345-0@lo:400: 00000100:00100000:0.0:1788940565.149465:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944812032:12345-0@lo:400: Request processed in 25us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940565.149472:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788940565.149481:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788940565.149487:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944811392:12345-0@lo:400: 00000100:00100000:0.0:1788940565.149509:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944811392:12345-0@lo:400: Request processed in 22us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940565.149514:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788940565.149524:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788940565.149537:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944811904:12345-0@lo:400: 00000100:00100000:0.0:1788940565.149566:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944811904:12345-0@lo:400: Request processed in 31us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940565.149572:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788940565.149650:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944810880:0@lo:400: 00010000:00080000:0.0:1788940565.149665:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a2c000 x1875839944811392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940565.149676:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944811392:0@lo:400: 00010000:00080000:0.0:1788940565.149685:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a2c700 x1875839944811904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940565.149694:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944811904:0@lo:400: 00000100:00100000:0.0:1788940565.149703:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944810752:0@lo:400: 00010000:00080000:0.0:1788940565.149712:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a2ce00 x1875839944811264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940565.149721:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944811264:0@lo:400: 00010000:00080000:0.0:1788940565.149730:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a2f100 x1875839944811776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940565.149739:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944811776:0@lo:400: 00000100:00100000:0.0:1788940565.149780:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944810496:0@lo:400: 00000100:00100000:0.0:1788940565.149793:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944811008:0@lo:400: 00010000:00080000:0.0:1788940565.149803:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a2e680 x1875839944811520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940565.149826:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944811520:0@lo:400: 00010000:00080000:0.0:1788940565.149839:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a2dc00 x1875839944812032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940565.149847:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944812032:0@lo:400: 00000100:00100000:0.0:1788940565.149858:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944810624:0@lo:400: 00000100:00100000:0.0:1788940565.149869:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944811136:0@lo:400: 00000100:00100000:0.0:1788940565.149879:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944811648:0@lo:400: 00000100:00100000:1.0:1788940565.152278:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940565.152306:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944812160:0@lo:13: 00000100:00100000:1.0:1788940565.152408:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940565.152463:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944812160 00000100:00100000:1.0:1788940565.152471:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944812160 00000100:00100000:1.0:1788940565.152525:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788940565.152535:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944812160:12345-0@lo:13: 00002000:00000024:1.0:1788940565.152572:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940565.152621:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944812160:12345-0@lo:13: Request processed in 86us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940565.152628:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788940565.152673:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a53100 x1875839944812160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940565.152695:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944812160:0@lo:13: 00000100:00080000:2.0:1788940565.153065:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940565.153072:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940565.153076:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940565.153079:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940565.153564:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940565.153580:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944812288:0@lo:13: 00000100:00100000:1.0:1788940565.153626:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940565.153714:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944812288 00000100:00100000:2.0:1788940565.153731:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944812288 00000100:00100000:2.0:1788940565.153775:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788940565.153784:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944812288:12345-0@lo:13: 00002000:00000024:2.0:1788940565.153802:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940565.153846:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944812288:12345-0@lo:13: Request processed in 64us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940565.153853:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788940565.153904:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f71880 x1875839944812288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940565.153920:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944812288:0@lo:13: 00010000:00010000:0.0:1788940565.787742:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940566.811594:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940567.708576:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940567.708603:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944812416:0@lo:41: 00000100:00100000:3.0:1788940567.708807:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940567.713682:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944812416 00000100:00100000:1.0:1788940567.714178:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944812416 00000100:00100000:0.0:1788940567.714332:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788940567.714345:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944812416:12345-0@lo:41: 00000004:00000024:0.0:1788940567.714390:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788940567.715208:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944812416:12345-0@lo:41: Request processed in 864us (6398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940567.715217:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788940567.715470:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944812416:0@lo:41: 00010000:00010000:1.0:1788940567.837016:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788940567.868764:0:10337:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff43208c0 20000000:00000080:3.0:1788940567.868782:0:10337:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91cf06ce0000 uarg=0000000000000000 20000000:01000000:3.0:1788940567.868829:0:10337:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788940567.868831:0:10337:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788940567.868834:0:10337:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788940567.868839:0:10337:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788940567.868844:0:10337:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788940567.868903:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788940567.868906:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788940567.873168:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1788940567.873817:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1788940567.873851:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1788940567.873868:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1788940567.873882:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788940567.873885:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788940567.874815:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1788940567.875606:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1788940567.875640:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1788940567.875656:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1788940567.875666:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788940567.875669:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788940567.876215:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1788940567.876566:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1788940567.876591:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1788940567.876605:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1788940567.876615:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788940567.876627:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788940567.877399:0:10341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1788940567.877560:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1788940567.877580:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1788940567.877591:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1788940567.877601:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788940567.877603:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788940567.877996:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1788940567.878580:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1788940567.878603:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1788940567.878617:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:3.0:1788940567.878630:0:10337:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788940567.878649:0:10337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d0027f6600/0x9c34acc08badd155 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.878668:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584ca00/0x9c34acc08badcff0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcfe9 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.878676:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d0421c1200/0x9c34acc08badd01a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd013 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.878683:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584cc00/0x9c34acc08badd059 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd052 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.878691:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d042053200/0x9c34acc08badd067 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd060 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.878698:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d042052c00/0x9c34acc08badd075 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd06e expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.878705:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d02eaabc00/0x9c34acc08badd091 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd08a expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.878711:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d02eaaa000/0x9c34acc08badd0bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd0b4 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.878728:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584c200/0x9c34acc08badd0d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd0d0 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.878736:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d0421c0a00/0x9c34acc08badd101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd0fa expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.878745:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584d000/0x9c34acc08badd10f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc70d8 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.878754:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badd116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc70df expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.878762:0:10337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d0027f6600/0x9c34acc08badd155 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.878804:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badd116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc70df expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.878819:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badd116 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc70df expref: 9 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940567.878833:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944812544:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940567.879293:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584d000/0x9c34acc08badd10f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc70d8 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.879304:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584d000/0x9c34acc08badd10f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc70d8 expref: 9 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940567.879313:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944812672:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940567.879363:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d0421c0a00/0x9c34acc08badd101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badd0fa expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.879372:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d0421c0a00/0x9c34acc08badd101 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badd0fa expref: 23 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940567.879381:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944812800:0@lo:104: 00000100:00100000:3.0:1788940567.879422:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940567.879453:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584c200/0x9c34acc08badd0d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badd0d0 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.879462:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584c200/0x9c34acc08badd0d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badd0d0 expref: 23 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940567.879469:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944812928:0@lo:104: 00000100:00100000:3.0:1788940567.879489:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940567.879520:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944812800 00000100:00100000:3.0:1788940567.879527:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944812800 00000100:00100000:3.0:1788940567.879559:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944812928 00000100:00100000:3.0:1788940567.879562:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944812928 00000100:00100000:3.0:1788940567.879576:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788940567.879585:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:10337:x1875839944812800:12345-0@lo:104: 00010000:00010000:3.0:1788940567.879597:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa400/0x9c34acc08badd0fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd101 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.879642:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940567.879648:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:10337:x1875839944812800:12345-0@lo:104: Request processed in 64us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940567.879655:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788940567.879677:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940567.879683:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:10337:x1875839944812928:12345-0@lo:104: 00010000:00010000:3.0:1788940567.879690:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd0d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd0d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.879732:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788940567.879737:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:10337:x1875839944812928:12345-0@lo:104: Request processed in 54us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940567.879743:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1788940567.879762:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940567.879767:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa400/0x9c34acc08badd0fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd101 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.879775:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaaa400 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940567.879778:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa400/0x9c34acc08badd0fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badd101 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.879787:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa400/0x9c34acc08badd0fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badd101 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940567.879794:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa400/0x9c34acc08badd0fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badd101 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940567.879801:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940567.879826:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa400/0x9c34acc08badd0fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd101 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.879833:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940567.879848:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa400/0x9c34acc08badd0fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd101 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.879864:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa400/0x9c34acc08badd0fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd101 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.879875:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940567.879878:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd0d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd0d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.879884:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584de00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940567.879887:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd0d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badd0d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.879893:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badd0d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940567.879900:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badd0d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940567.879906:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940567.880762:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd0d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd0d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.880770:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940567.880778:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd0d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd0d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.880784:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd0d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd0d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.880793:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940567.880801:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940567.880802:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940567.880865:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940567.880887:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944813056:0@lo:103: 00000100:00100000:1.0:1788940567.880942:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940567.881002:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944813056 00000100:00100000:0.0:1788940567.881018:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944813056 00010000:00010000:0.0:1788940567.881045:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d0421c0a00/0x9c34acc08badd101 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd0fa expref: 24 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940567.881089:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788940567.881105:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050d9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944813056:12345-0@lo:103: 00010000:00010000:0.0:1788940567.881117:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940567.881122:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d0421c0a00/0x9c34acc08badd101 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd0fa expref: 24 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940567.881132:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d0421c0a00/0x9c34acc08badd101 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badd0fa expref: 24 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940567.881148:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940567.881176:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050d9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944813056:12345-0@lo:103: Request processed in 74us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940567.881182:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788940567.881557:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d02eaaa000/0x9c34acc08badd0bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badd0b4 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940567.881568:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d02eaaa000/0x9c34acc08badd0bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badd0b4 expref: 23 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940567.881579:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944813312:0@lo:104: 00000100:00100000:2.0:1788940567.881607:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788940567.881672:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d02eaabc00/0x9c34acc08badd091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badd08a expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940567.881681:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d02eaabc00/0x9c34acc08badd091 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badd08a expref: 23 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940567.881689:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944813440:0@lo:104: 00000100:00100000:2.0:1788940567.881711:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940567.881768:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944813056:0@lo:103: 00000100:00100000:1.0:1788940567.881787:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940567.881793:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944813184:0@lo:103: 00000100:00100000:1.0:1788940567.881815:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940567.881901:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944813184 00000100:00100000:0.0:1788940567.881906:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944813184 00010000:00010000:0.0:1788940567.881932:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584c200/0x9c34acc08badd0d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd0d0 expref: 24 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940567.881960:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788940567.881967:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944813184:12345-0@lo:103: 00010000:00010000:0.0:1788940567.881975:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940567.881979:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584c200/0x9c34acc08badd0d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd0d0 expref: 24 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940567.881986:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584c200/0x9c34acc08badd0d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badd0d0 expref: 24 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940567.881998:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940567.882034:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944813184:12345-0@lo:103: Request processed in 68us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940567.882041:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788940567.882344:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944813184:0@lo:103: 00010000:00010000:2.0:1788940567.882697:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d042052c00/0x9c34acc08badd075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badd06e expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940567.882707:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d042052c00/0x9c34acc08badd075 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badd06e expref: 23 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940567.882717:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944813568:0@lo:104: 00010000:00010000:2.0:1788940567.882745:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d042053200/0x9c34acc08badd067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badd060 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940567.882765:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d042053200/0x9c34acc08badd067 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badd060 expref: 23 pid: 6513 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940567.882773:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f73800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944813696:0@lo:104: 00010000:00010000:2.0:1788940567.882801:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584cc00/0x9c34acc08badd059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badd052 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940567.882808:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584cc00/0x9c34acc08badd059 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badd052 expref: 23 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940567.882815:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f72a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944813824:0@lo:104: 00010000:00010000:2.0:1788940567.882837:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d0421c1200/0x9c34acc08badd01a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badd013 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940567.882845:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d0421c1200/0x9c34acc08badd01a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badd013 expref: 23 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940567.882853:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944813952:0@lo:104: 00010000:00010000:2.0:1788940567.882874:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584ca00/0x9c34acc08badcff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badcfe9 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940567.882881:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584ca00/0x9c34acc08badcff0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badcfe9 expref: 23 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940567.882888:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944814080:0@lo:104: 00000100:00100000:2.0:1788940567.882906:0:10337:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310ccb40 going to sleep for 11 seconds 00010000:00010000:2.0:1788940567.883146:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0421c0a00/0x9c34acc08badd101 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badd0fa expref: 23 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940567.883169:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944812800:0@lo:104: 00010000:00010000:2.0:1788940567.883182:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584c200/0x9c34acc08badd0d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badd0d0 expref: 22 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940567.883190:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944812928:0@lo:104: 00000100:00100000:2.0:1788940567.883544:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788940567.883569:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940567.883584:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940567.883594:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940567.883601:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940567.883626:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940567.883639:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944813312 00000100:00100000:2.0:1788940567.883644:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944813312 00000100:00100000:2.0:1788940567.883674:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944813440 00000100:00100000:2.0:1788940567.883678:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944813440 00000100:00100000:2.0:1788940567.883689:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944813568 00000100:00100000:2.0:1788940567.883691:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944813568 00000100:00100000:2.0:1788940567.883700:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944813696 00000100:00100000:2.0:1788940567.883703:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944813696 00000100:00100000:2.0:1788940567.883712:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944813824 00000100:00100000:2.0:1788940567.883713:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944813824 00000100:00100000:2.0:1788940567.883722:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944813952 00000100:00100000:2.0:1788940567.883723:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944813952 00000100:00100000:2.0:1788940567.883731:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944814080 00000100:00100000:2.0:1788940567.883733:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944814080 00000100:00100000:2.0:1788940567.883744:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940567.883750:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+9:10337:x1875839944813312:12345-0@lo:104: 00010000:00010000:2.0:1788940567.883762:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badd0b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd0bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940567.883825:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788940567.883831:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+9:10337:x1875839944813312:12345-0@lo:104: Request processed in 81us (2224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940567.883838:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940567.883854:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788940567.883859:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03779fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+8:10337:x1875839944813440:12345-0@lo:104: 00010000:00010000:2.0:1788940567.883867:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badd08a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd091 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940567.883900:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788940567.883905:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03779fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+8:10337:x1875839944813440:12345-0@lo:104: Request processed in 46us (2193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940567.883974:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788940567.884024:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940567.884029:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+7:10337:x1875839944813568:12345-0@lo:104: 00010000:00010000:2.0:1788940567.884037:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd06e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd075 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940567.884064:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788940567.884068:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+7:10337:x1875839944813568:12345-0@lo:104: Request processed in 40us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940567.884193:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940567.884208:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788940567.884215:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+6:10337:x1875839944813696:12345-0@lo:104: 00010000:00010000:2.0:1788940567.884223:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d02eaab200/0x9c34acc08badd060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd067 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940567.884367:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788940567.884373:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+6:10337:x1875839944813696:12345-0@lo:104: Request processed in 160us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940567.884380:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788940567.884395:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788940567.884401:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+5:10337:x1875839944813824:12345-0@lo:104: 00010000:00010000:2.0:1788940567.884407:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d0421c0c00/0x9c34acc08badd052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd059 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940567.884436:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788940567.884441:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+5:10337:x1875839944813824:12345-0@lo:104: Request processed in 42us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940567.884446:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788940567.884459:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788940567.884464:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:10337:x1875839944813952:12345-0@lo:104: 00010000:00010000:2.0:1788940567.884470:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd01a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940567.884497:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788940567.884502:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:10337:x1875839944813952:12345-0@lo:104: Request processed in 39us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940567.884507:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788940567.884519:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788940567.884525:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:10337:x1875839944814080:12345-0@lo:104: 00010000:00010000:2.0:1788940567.884532:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d02eaaac00/0x9c34acc08badcfe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcff0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940567.884568:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788940567.884573:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:10337:x1875839944814080:12345-0@lo:104: Request processed in 49us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940567.884580:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1788940567.884653:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788940567.884660:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badd0b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd0bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.884667:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaab800 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940567.884671:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badd0b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badd0bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.884680:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badd0b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badd0bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940567.884688:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badd0b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badd0bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940567.884694:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940567.884733:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badd0b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd0bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.884740:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940567.884761:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badd0b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd0bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.884768:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02eaab800/0x9c34acc08badd0b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd0bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.884780:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788940567.884784:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badd08a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd091 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.884801:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584d200 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940567.884804:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badd08a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badd091 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.884811:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badd08a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badd091 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940567.884818:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badd08a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badd091 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940567.884822:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940567.884836:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badd08a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd091 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.884842:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940567.884848:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badd08a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd091 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.884854:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badd08a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd091 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.884864:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788940567.884867:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd06e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd075 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.884873:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584ce00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940567.884876:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd06e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badd075 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.884894:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd06e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badd075 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940567.884900:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd06e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badd075 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940567.884906:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940567.884933:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd06e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd075 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.884939:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940567.884954:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd06e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd075 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.884960:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd06e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd075 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.884970:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788940567.884973:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02eaab200/0x9c34acc08badd060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd067 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.884978:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaab200 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940567.884981:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaab200/0x9c34acc08badd060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badd067 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.884987:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02eaab200/0x9c34acc08badd060 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badd067 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940567.884994:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaab200/0x9c34acc08badd060 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badd067 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940567.885004:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940567.885030:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d02eaab200/0x9c34acc08badd060 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd067 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.885037:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940567.885043:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02eaab200/0x9c34acc08badd060 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd067 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.885049:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02eaab200/0x9c34acc08badd060 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd067 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.885058:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788940567.885061:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0421c0c00/0x9c34acc08badd052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd059 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.885067:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c0c00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940567.885070:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c0c00/0x9c34acc08badd052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badd059 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.885483:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0421c0c00/0x9c34acc08badd052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badd059 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940567.885489:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c0c00/0x9c34acc08badd052 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badd059 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940567.885494:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940567.885509:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0421c0c00/0x9c34acc08badd052 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd059 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.885515:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940567.885525:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0421c0c00/0x9c34acc08badd052 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd059 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.885531:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0421c0c00/0x9c34acc08badd052 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd059 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.885542:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940567.885545:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd01a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.885551:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042052a00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940567.885553:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badd01a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.885560:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badd01a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940567.885617:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badd01a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940567.885623:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940567.885638:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd013 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd01a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.885643:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940567.885648:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd013 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd01a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.885653:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd013 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd01a expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.885664:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940567.885674:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02eaaac00/0x9c34acc08badcfe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcff0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.885680:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaaac00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940567.885682:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaaac00/0x9c34acc08badcfe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcff0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.885689:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02eaaac00/0x9c34acc08badcfe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcff0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940567.885695:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaaac00/0x9c34acc08badcfe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcff0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940567.885700:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940567.885713:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d02eaaac00/0x9c34acc08badcfe9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcff0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.885719:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940567.885722:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02eaaac00/0x9c34acc08badcfe9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcff0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.885729:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02eaaac00/0x9c34acc08badcfe9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcff0 expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.885741:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940567.885744:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940567.885745:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940567.885783:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944813312:0@lo:104: 00000100:00100000:3.0:1788940567.885794:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944813440:0@lo:104: 00000100:00100000:3.0:1788940567.885803:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944813568:0@lo:104: 00000100:00100000:3.0:1788940567.885819:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f73800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944813696:0@lo:104: 00000100:00100000:3.0:1788940567.885826:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f72a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944813824:0@lo:104: 00000100:00100000:3.0:1788940567.885832:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944813952:0@lo:104: 00000100:00100000:3.0:1788940567.885839:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944814080:0@lo:104: 00000100:00100000:0.0:1788940567.885943:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944814336:0@lo:103: 00000100:00100000:0.0:1788940567.885993:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940567.886044:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944814848:0@lo:103: 00000100:00100000:0.0:1788940567.886063:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940567.886203:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788940567.886211:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944814208:0@lo:103: 00000100:00100000:0.0:1788940567.886233:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940567.886332:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944814720:0@lo:103: 00000100:00100000:0.0:1788940567.886361:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940567.886394:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944814336 00000100:00100000:0.0:1788940567.886401:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944814336 00010000:00010000:0.0:1788940567.886426:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d02eaabc00/0x9c34acc08badd091 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd08a expref: 22 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940567.886447:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944814848 00000100:00100000:0.0:1788940567.886450:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944814848 00010000:00010000:0.0:1788940567.886460:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d0421c1200/0x9c34acc08badd01a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd013 expref: 23 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940567.886470:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944814208 00000100:00100000:0.0:1788940567.886473:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944814208 00010000:00010000:0.0:1788940567.886482:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d02eaaa000/0x9c34acc08badd0bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd0b4 expref: 24 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940567.886492:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944814720 00000100:00100000:0.0:1788940567.886494:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944814720 00010000:00010000:0.0:1788940567.886502:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584cc00/0x9c34acc08badd059 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd052 expref: 25 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940567.886514:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788940567.886529:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+25:3648:x1875839944814336:12345-0@lo:103: 00010000:00010000:0.0:1788940567.886542:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940567.886547:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d02eaabc00/0x9c34acc08badd091 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd08a expref: 25 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940567.886557:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d02eaabc00/0x9c34acc08badd091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badd08a expref: 25 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940567.886574:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaabc00/0x9c34acc08badd091 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badd08a expref: 25 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940567.886586:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940567.886616:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944814336:12345-0@lo:103: Request processed in 88us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940567.886622:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788940567.886638:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788940567.886644:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:3648:x1875839944814848:12345-0@lo:103: 00010000:00010000:0.0:1788940567.886652:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940567.886656:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d0421c1200/0x9c34acc08badd01a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd013 expref: 23 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940567.886664:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d0421c1200/0x9c34acc08badd01a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badd013 expref: 23 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940567.886673:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0421c1200/0x9c34acc08badd01a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badd013 expref: 23 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940567.886682:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940567.886702:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:3648:x1875839944814848:12345-0@lo:103: Request processed in 59us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940567.886717:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788940567.886729:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788940567.886734:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:3648:x1875839944814208:12345-0@lo:103: 00010000:00010000:0.0:1788940567.886742:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940567.886746:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d02eaaa000/0x9c34acc08badd0bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd0b4 expref: 21 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940567.886754:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d02eaaa000/0x9c34acc08badd0bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badd0b4 expref: 21 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940567.886764:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaaa000/0x9c34acc08badd0bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badd0b4 expref: 21 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940567.886772:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940567.886791:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:3648:x1875839944814208:12345-0@lo:103: Request processed in 57us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940567.886796:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788940567.886807:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788940567.886812:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:3648:x1875839944814720:12345-0@lo:103: 00010000:00010000:0.0:1788940567.886819:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940567.886824:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584cc00/0x9c34acc08badd059 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd052 expref: 19 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940567.886831:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584cc00/0x9c34acc08badd059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badd052 expref: 19 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940567.886840:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584cc00/0x9c34acc08badd059 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badd052 expref: 19 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940567.886858:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940567.886880:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:3648:x1875839944814720:12345-0@lo:103: Request processed in 68us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940567.886886:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788940567.886911:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944814208:0@lo:103: 00000100:00100000:0.0:1788940567.886918:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944814720:0@lo:103: 00000100:00100000:0.0:1788940567.886924:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944814336:0@lo:103: 00000100:00100000:0.0:1788940567.886931:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944814848:0@lo:103: 00000100:00100000:2.0:1788940567.887248:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940567.887342:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940567.887539:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921689216 00000100:00100000:3.0:1788940567.887545:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921689216 00010000:00010000:3.0:1788940567.887567:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badd116 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc70df expref: 10 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940567.887583:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921689344 00000100:00100000:3.0:1788940567.887586:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921689344 00010000:00010000:3.0:1788940567.887596:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584d000/0x9c34acc08badd10f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc70d8 expref: 11 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940567.887608:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:3.0:1788940567.887615:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08584380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:2405:x1875839921689216:12345-192.168.202.25@tcp:103: 00010000:00010000:3.0:1788940567.887625:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940567.887630:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badd116 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc70df expref: 11 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.887640:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badd116 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc70df expref: 11 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.887652:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940567.887703:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08584380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:2405:x1875839921689216:12345-192.168.202.25@tcp:103: Request processed in 87us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940567.887709:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:3.0:1788940567.887724:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:3.0:1788940567.887740:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2405:x1875839921689344:12345-192.168.202.25@tcp:103: 00010000:00010000:3.0:1788940567.887748:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940567.887753:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584d000/0x9c34acc08badd10f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc70d8 expref: 10 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.887762:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584d000/0x9c34acc08badd10f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc70d8 expref: 10 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.887773:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940567.887792:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2405:x1875839921689344:12345-192.168.202.25@tcp:103: Request processed in 53us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940567.887798:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 31 00010000:00010000:3.0:1788940567.887854:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badd116 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc70df expref: 9 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940567.887866:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944812544:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940567.887877:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584d000/0x9c34acc08badd10f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc70d8 expref: 8 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940567.887885:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875839944812672:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940567.887924:0:10337:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d0027f6600/0x9c34acc08badd155 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940567.888274:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:1.0:1788940567.888321:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944814592:0@lo:103: 00000100:00100000:1.0:1788940567.888368:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940567.888401:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788940567.888408:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944814464:0@lo:103: 00000100:00100000:1.0:1788940567.888427:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940567.888437:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944814976:0@lo:103: 00000100:00100000:1.0:1788940567.888454:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940567.888470:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940567.888480:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944814592 00000100:00100000:1.0:1788940567.888484:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944814592 00010000:00010000:1.0:1788940567.888501:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d042053200/0x9c34acc08badd067 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd060 expref: 18 pid: 6513 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940567.888515:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944814464 00000100:00100000:1.0:1788940567.888518:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944814464 00010000:00010000:1.0:1788940567.888528:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d042052c00/0x9c34acc08badd075 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd06e expref: 19 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940567.888537:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944814976 00000100:00100000:1.0:1788940567.888540:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944814976 00010000:00010000:1.0:1788940567.888550:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584ca00/0x9c34acc08badcff0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcfe9 expref: 20 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940567.888561:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788940567.888567:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:3646:x1875839944814592:12345-0@lo:103: 00010000:00010000:1.0:1788940567.888575:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940567.888579:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d042053200/0x9c34acc08badd067 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd060 expref: 20 pid: 6513 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940567.888596:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d042053200/0x9c34acc08badd067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badd060 expref: 20 pid: 6513 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940567.888607:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d042053200/0x9c34acc08badd067 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badd060 expref: 20 pid: 6513 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940567.888618:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940567.888647:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:3646:x1875839944814592:12345-0@lo:103: Request processed in 80us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940567.888653:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788940567.888666:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788940567.888671:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:3646:x1875839944814464:12345-0@lo:103: 00010000:00010000:1.0:1788940567.888678:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940567.888682:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d042052c00/0x9c34acc08badd075 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd06e expref: 18 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940567.888690:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d042052c00/0x9c34acc08badd075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badd06e expref: 18 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940567.888699:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d042052c00/0x9c34acc08badd075 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badd06e expref: 18 pid: 6512 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940567.888708:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940567.888727:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:3646:x1875839944814464:12345-0@lo:103: Request processed in 56us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940567.888732:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788940567.888743:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788940567.888748:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:3646:x1875839944814976:12345-0@lo:103: 00010000:00010000:1.0:1788940567.888760:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940567.888765:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584ca00/0x9c34acc08badcff0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcfe9 expref: 16 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940567.888774:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584ca00/0x9c34acc08badcff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badcfe9 expref: 16 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940567.888782:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584ca00/0x9c34acc08badcff0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badcfe9 expref: 16 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940567.888793:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d0027f6600/0x9c34acc08badd155 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940567.888802:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0027f6600/0x9c34acc08badd155 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940567.888815:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d0027f6600/0x9c34acc08badd155 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940567.888822:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d0027f6600/0x9c34acc08badd155 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940567.888828:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d0027f6600/0x9c34acc08badd155 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940567.888836:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d0027f6600/0x9c34acc08badd155 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940567.888842:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6600 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940567.888846:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d0027f6600/0x9c34acc08badd155 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940567.888865:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d0027f6600/0x9c34acc08badd155 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940567.888877:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d0027f6600/0x9c34acc08badd155 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940567.888887:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940567.888910:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:3646:x1875839944814976:12345-0@lo:103: Request processed in 162us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940567.888916:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788940567.888943:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944814464:0@lo:103: 00000100:00100000:1.0:1788940567.888950:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944814976:0@lo:103: 00000100:00100000:1.0:1788940567.888956:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944814592:0@lo:103: 00010000:00010000:3.0:1788940567.889393:0:10337:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d0027f6600/0x9c34acc08badd155 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.889403:0:10337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d0027f6600/0x9c34acc08badd155 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940567.889421:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0027f6600/0x9c34acc08badd155 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940568.220399:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940568.220428:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944815104:0@lo:13: 00000100:00100000:2.0:1788940568.222592:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944815232:0@lo:13: 00000100:00100000:2.0:1788940568.234511:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940568.234823:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944815232 00000100:00100000:1.0:1788940568.234836:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944815232 00000100:00100000:1.0:1788940568.234910:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788940568.234922:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944815232:12345-0@lo:13: 00002000:00000024:1.0:1788940568.234955:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940568.235034:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944815232:12345-0@lo:13: Request processed in 115us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940568.235041:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788940568.235542:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788940568.236116:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940568.236137:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944815104 00000100:00100000:2.0:1788940568.236147:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944815104 00000100:00100000:2.0:1788940568.236383:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788940568.236392:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944815104:12345-0@lo:13: 00002000:00000024:2.0:1788940568.236411:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940568.236467:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944815104:12345-0@lo:13: Request processed in 77us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940568.236474:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788940568.236525:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ff1180 x1875839944815232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940568.236549:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944815232:0@lo:13: 00010000:00080000:0.0:1788940568.237897:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08587800 x1875839944815104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940568.237930:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944815104:0@lo:13: 00000100:00080000:3.0:1788940568.241435:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788940568.859614:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940568.874975:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940568.875118:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940568.875145:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940568.875179:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940568.875434:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921689600 00000100:00100000:0.0:1788940568.875444:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921689600 00000100:00100000:0.0:1788940568.875520:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921689728 00000100:00100000:0.0:1788940568.875524:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921689728 00000100:00100000:0.0:1788940568.875550:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 72 00000100:00100000:0.0:1788940568.875560:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921689600:12345-192.168.202.25@tcp:400: 00000100:00100000:0.0:1788940568.875635:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921689600:12345-192.168.202.25@tcp:400: Request processed in 77us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940568.875642:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 72 00000100:00100000:0.0:1788940568.875659:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 73 00000100:00100000:0.0:1788940568.875665:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921689728:12345-192.168.202.25@tcp:400: 00000100:00100000:0.0:1788940568.875698:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921689728:12345-192.168.202.25@tcp:400: Request processed in 33us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940568.875722:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 73 00000100:00100000:0.0:1788940568.875740:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921689984 00000100:00100000:0.0:1788940568.875744:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921689984 00000100:00100000:0.0:1788940568.875769:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:0.0:1788940568.875775:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921689984:12345-192.168.202.25@tcp:400: 00000100:00100000:0.0:1788940568.875800:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921689984:12345-192.168.202.25@tcp:400: Request processed in 26us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940568.875806:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00080000:2.0:1788940568.878225:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940568.878249:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940568.878252:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940568.878908:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940568.878996:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921689472 00000100:00100000:1.0:1788940568.879008:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921689472 00000100:00100000:0.0:1788940568.879122:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921689856 00000100:00100000:0.0:1788940568.879126:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921689856 00000100:00100000:0.0:1788940568.879179:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:0.0:1788940568.879188:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921689856:12345-192.168.202.25@tcp:400: 00000100:00100000:0.0:1788940568.879250:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921689856:12345-192.168.202.25@tcp:400: Request processed in 63us (348us total) trans 0 rc 0/0 00000100:00080000:2.0:1788940568.879426:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940568.879947:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 203 00000100:00100000:1.0:1788940568.879968:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+8:2405:x1875839921689472:12345-192.168.202.25@tcp:400: 00000100:00100000:1.0:1788940568.880012:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+8:2405:x1875839921689472:12345-192.168.202.25@tcp:400: Request processed in 47us (5048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940568.880019:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 203 00000100:00100000:0.0:1788940568.880073:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 24 10000000:01000000:2.0:1788940568.987442:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788940568.987453:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91d037817800 from 48 10000000:01000000:2.0:1788940568.987459:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788940568.987511:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd15c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940568.987524:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd15c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940568.987537:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd15c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940568.987561:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944815360:0@lo:101: 00000100:00100000:2.0:1788940568.987631:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940568.987865:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944815360 00000100:00100000:0.0:1788940568.987874:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944815360 00000100:00100000:0.0:1788940568.987950:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788940568.987960:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+15:6517:x1875839944815360:12345-0@lo:101: 00010000:00010000:0.0:1788940568.987974:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940568.987988:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584cc00/0x9c34acc08badd163 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd15c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940568.988023:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584cc00/0x9c34acc08badd163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd15c expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940568.988033:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584cc00/0x9c34acc08badd163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd15c expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940568.988056:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584cc00, rc 0) 00000100:00100000:0.0:1788940568.988095:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944815360:12345-0@lo:101: Request processed in 136us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940568.988102:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788940568.988606:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49600 going to sleep for 11 seconds 00000100:00100000:2.0:1788940568.988635:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944815360:0@lo:101: 00010000:00010000:2.0:1788940568.988652:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd15c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd163 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940568.988663:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd15c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd163 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940568.988747:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944815488:0@lo:501: 00000100:00100000:2.0:1788940568.988781:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940568.988851:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944815488 00000100:00100000:1.0:1788940568.988857:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944815488 00000100:00100000:1.0:1788940568.988897:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788940568.988913:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944815488:12345-0@lo:501: 00000100:00100000:1.0:1788940568.989050:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944815488:12345-0@lo:501: Request processed in 138us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940568.989057:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788940568.989584:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49600 going to sleep for 11 seconds 00000100:00100000:2.0:1788940568.989604:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944815488:0@lo:501: 00000100:00100000:2.0:1788940568.989650:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944815616:0@lo:503: 00000100:00100000:2.0:1788940568.989992:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940568.990126:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940568.994452:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944815616 00000100:00100000:3.0:1788940568.994470:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944815616 00000100:00100000:3.0:1788940568.994614:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788940568.994626:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944815616:12345-0@lo:503: 00000100:00100000:3.0:1788940568.996051:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944815616:12345-0@lo:503: Request processed in 1420us (6347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940568.996065:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788940569.004448:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944815616:0@lo:503: 00000100:00100000:2.0:1788940569.005691:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10354:1875839944815744:0@lo:502: 00000100:00100000:2.0:1788940569.006462:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940569.006512:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940569.006581:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944815744 00000100:00100000:0.0:1788940569.006590:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944815744 00000100:00100000:0.0:1788940569.006644:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788940569.006654:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:10354:x1875839944815744:12345-0@lo:502: 00000100:00100000:0.0:1788940569.007239:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:10354:x1875839944815744:12345-0@lo:502: Request processed in 585us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940569.007248:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788940569.007878:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10354:1875839944815744:0@lo:502: 00000100:00100000:2.0:1788940569.008103:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10354:1875839944815872:0@lo:502: 00000100:00100000:2.0:1788940569.008157:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940569.008191:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940569.008386:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944815872 00000100:00100000:3.0:1788940569.008393:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944815872 00000100:00100000:3.0:1788940569.008440:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788940569.008449:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:10354:x1875839944815872:12345-0@lo:502: 00000100:00100000:3.0:1788940569.008555:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:10354:x1875839944815872:12345-0@lo:502: Request processed in 107us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940569.008563:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788940569.009404:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10354:1875839944815872:0@lo:502: 00000040:00080000:2.0:1788940569.009439:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788940569.009678:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788940569.010096:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788940569.010108:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd15c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd163 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.010121:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd15c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd163 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940569.010131:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788940569.010133:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788940569.010137:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788940569.010172:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badd16a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.010180:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badd16a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.010190:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badd16a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940569.010219:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944816000:0@lo:101: 00000100:00100000:1.0:1788940569.010801:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940569.010840:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06f4e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788940569.010983:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944816000 00000100:00100000:2.0:1788940569.010991:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944816000 00000100:00100000:2.0:1788940569.011111:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788940569.011121:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+16:6517:x1875839944816000:12345-0@lo:101: 00010000:00010000:2.0:1788940569.011134:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940569.011148:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d042052c00/0x9c34acc08badd171 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd16a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940569.011172:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d042052c00/0x9c34acc08badd171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd16a expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940569.011183:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d042052c00/0x9c34acc08badd171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd16a expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940569.011203:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d042052c00, rc 0) 00000100:00100000:2.0:1788940569.011254:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944816000:12345-0@lo:101: Request processed in 135us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940569.011804:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944816000:0@lo:101: 00010000:00010000:1.0:1788940569.011821:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badd16a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd171 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.011831:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badd16a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd171 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940569.011896:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944816128:0@lo:501: 00000100:00100000:2.0:1788940569.011991:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788940569.012095:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940569.012130:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06f4e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788940569.012405:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944816128 00000100:00100000:3.0:1788940569.012412:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944816128 00000100:00100000:3.0:1788940569.012455:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788940569.012464:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944816128:12345-0@lo:501: 00000100:00100000:3.0:1788940569.012600:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944816128:12345-0@lo:501: Request processed in 137us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940569.012607:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788940569.013217:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944816128:0@lo:501: 00000100:00100000:2.0:1788940569.013759:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944816256:0@lo:503: 00000100:00100000:2.0:1788940569.013816:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940569.013844:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940569.013993:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944816256 00000100:00100000:3.0:1788940569.014066:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944816256 00000100:00100000:3.0:1788940569.014147:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788940569.014156:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944816256:12345-0@lo:503: 00000100:00100000:3.0:1788940569.014298:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944816256:12345-0@lo:503: Request processed in 143us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940569.014305:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788940569.014399:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944816256:0@lo:503: 00000100:00100000:0.0:1788940569.019568:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10355:1875839944816384:0@lo:502: 00000100:00100000:0.0:1788940569.019668:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940569.019941:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d034717e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940569.027577:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944816384 00000100:00100000:1.0:1788940569.027597:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944816384 00000100:00100000:1.0:1788940569.027667:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788940569.027685:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:10355:x1875839944816384:12345-0@lo:502: 00000100:00100000:1.0:1788940569.027942:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:10355:x1875839944816384:12345-0@lo:502: Request processed in 265us (8273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940569.027950:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788940569.028161:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10355:1875839944816384:0@lo:502: 00000020:01000000:0.0:1788940569.028204:0:10355:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940569.028214:0:10355:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940569.028217:0:10355:0:(obd_config.c:1662:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788940569.028223:0:10355:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788940569.028292:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10355:1875839944816512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940569.028337:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940569.028387:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d006999b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940569.028508:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944816512 00000100:00100000:1.0:1788940569.028514:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944816512 00000100:00100000:1.0:1788940569.028536:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788940569.028542:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:10355:x1875839944816512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940569.028619:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:10355:x1875839944816512:12345-0@lo:502:llog_process_th.0 Request processed in 76us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940569.028632:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788940569.028843:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10355:1875839944816512:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940569.028861:0:10355:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940569.028865:0:10355:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940569.028871:0:10355:0:(obd_config.c:1662:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788940569.028874:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1788940569.029110:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788940569.029131:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788940569.029141:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badd16a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd171 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.029152:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badd16a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd171 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940569.029161:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788940569.029164:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91d035758800 from 48 10000000:01000000:1.0:1788940569.029166:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788940569.029191:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badd178 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.029198:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badd178 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.029206:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badd178 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940569.029220:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944816640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788940569.029248:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940569.029305:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06f4e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788940569.029318:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944816640 00000100:00100000:1.0:1788940569.029322:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944816640 00000100:00100000:1.0:1788940569.029353:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788940569.029361:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+17:6517:x1875839944816640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940569.029370:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940569.029390:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badd17f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd178 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.029414:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badd17f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd178 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.029425:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badd17f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd178 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.029433:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaaae00, rc 0) 00000100:00100000:1.0:1788940569.029462:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944816640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940569.029469:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788940569.029496:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944816640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940569.029507:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badd178 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd17f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.029516:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badd178 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd17f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940569.029563:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944816768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940569.029588:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940569.029601:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06f4e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788940569.029611:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944816768 00000100:00100000:1.0:1788940569.029615:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944816768 00000100:00100000:1.0:1788940569.029631:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788940569.029636:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944816768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940569.029888:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944816768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940569.029902:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788940569.029944:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944816768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940569.029969:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944816896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940569.030123:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940569.030138:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06f4e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788940569.030150:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944816896 00000100:00100000:1.0:1788940569.030153:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944816896 00000100:00100000:1.0:1788940569.030169:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788940569.030175:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944816896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940569.030249:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944816896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940569.030416:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944816896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940569.030606:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10356:1875839944817024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940569.030644:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940569.030654:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d006999b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940569.031073:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788940569.031108:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944817024 00000100:00100000:1.0:1788940569.031114:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944817024 00000100:00100000:1.0:1788940569.031133:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788940569.031140:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:10356:x1875839944817024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940569.031242:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:10356:x1875839944817024:12345-0@lo:502:llog_process_th.0 Request processed in 101us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940569.031248:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788940569.031669:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10356:1875839944817024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940569.031777:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10356:1875839944817152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940569.031819:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940569.031844:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359e2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940569.031896:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944817152 00000100:00100000:1.0:1788940569.031909:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944817152 00000100:00100000:1.0:1788940569.032499:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788940569.032508:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:10356:x1875839944817152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940569.032774:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:10356:x1875839944817152:12345-0@lo:502:llog_process_th.0 Request processed in 267us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940569.032790:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788940569.033133:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10356:1875839944817152:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788940569.033163:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788940569.033509:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788940569.033533:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788940569.033544:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badd178 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd17f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940569.033557:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badd178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd17f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940569.033567:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788940569.033570:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788940569.033573:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788940569.033602:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08badd186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940569.033610:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08badd186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940569.033619:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08badd186 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940569.033647:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944817280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940569.033691:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940569.033819:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49600 going to sleep for 11 seconds 00000100:00100000:1.0:1788940569.033848:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944817280 00000100:00100000:1.0:1788940569.033854:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944817280 00000100:00100000:1.0:1788940569.033896:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788940569.033912:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+18:6517:x1875839944817280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940569.034579:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940569.034669:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584d000/0x9c34acc08badd18d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd186 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940569.034695:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584d000/0x9c34acc08badd18d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd186 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940569.038870:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584d000/0x9c34acc08badd18d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd186 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940569.038883:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584d000, rc 0) 00000100:00100000:0.0:1788940569.039233:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:6517:x1875839944817280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5328us (5540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940569.039242:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788940569.039651:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944817280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940569.039670:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08badd186 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd18d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940569.039687:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08badd186 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd18d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940569.039766:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944817408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940569.039796:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940569.039829:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310cc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940569.039833:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944817408 00000100:00100000:0.0:1788940569.039840:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944817408 00000100:00100000:0.0:1788940569.039909:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788940569.040143:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:6517:x1875839944817408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940569.040529:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:6517:x1875839944817408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 610us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940569.040538:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788940569.040731:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944817408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940569.040767:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944817536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940569.040831:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940569.040862:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310cc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940569.041791:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944817536 00000100:00100000:0.0:1788940569.041803:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944817536 00000100:00100000:0.0:1788940569.041856:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788940569.041864:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:6517:x1875839944817536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940569.042464:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:6517:x1875839944817536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 600us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940569.042474:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788940569.042776:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944817536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940569.044318:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10357:1875839944817664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940569.044396:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940569.044428:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06f4e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788940569.049088:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944817664 00000100:00100000:3.0:1788940569.049106:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944817664 00000100:00100000:3.0:1788940569.049190:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788940569.049201:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:10357:x1875839944817664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940569.049418:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:10357:x1875839944817664:12345-0@lo:502:llog_process_th.0 Request processed in 218us (5021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940569.049434:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788940569.050211:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10357:1875839944817664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940569.050249:0:10357:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940569.050277:0:10357:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940569.050280:0:10357:0:(obd_config.c:1662:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788940569.050287:0:10357:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788940569.050331:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10357:1875839944817792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940569.050396:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940569.050438:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310ccc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940569.050490:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944817792 00000100:00100000:0.0:1788940569.050496:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944817792 00000100:00100000:0.0:1788940569.050726:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788940569.050745:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:10357:x1875839944817792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940569.051610:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:10357:x1875839944817792:12345-0@lo:502:llog_process_th.0 Request processed in 873us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940569.051621:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788940569.053502:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10357:1875839944817792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788940569.053565:0:10357:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940569.053577:0:10357:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940569.053580:0:10357:0:(obd_config.c:1662:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788940569.053591:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1788940569.053720:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788940569.053754:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788940569.053766:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08badd186 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd18d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940569.053778:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08badd186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd18d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940569.053790:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788940569.053793:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91d034739000 from 48 10000000:01000000:2.0:1788940569.053797:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788940569.053836:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053000/0x9c34acc08badd194 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940569.053845:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d042053000/0x9c34acc08badd194 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940569.053855:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d042053000/0x9c34acc08badd194 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940569.053878:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08587100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944817920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940569.053959:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940569.054037:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944817920 00000100:00100000:1.0:1788940569.054044:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944817920 00000100:00100000:1.0:1788940569.054108:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788940569.054118:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:6517:x1875839944817920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940569.054133:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940569.054148:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaaac00/0x9c34acc08badd19b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd194 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.054172:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaaac00/0x9c34acc08badd19b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd194 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.054182:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaaac00/0x9c34acc08badd19b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd194 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.054207:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaaac00, rc 0) 00000100:00100000:1.0:1788940569.054242:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944817920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940569.054249:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788940569.054445:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940569.054468:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08587100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944817920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940569.054481:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d042053000/0x9c34acc08badd194 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd19b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940569.054491:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d042053000/0x9c34acc08badd194 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd19b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940569.054544:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08587100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944818048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940569.054568:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940569.054588:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940569.054644:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944818048 00000100:00100000:1.0:1788940569.054650:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944818048 00000100:00100000:1.0:1788940569.054681:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788940569.054688:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944818048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940569.054805:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944818048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940569.054812:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788940569.056667:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08587100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944818048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940569.056812:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08587100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944818176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940569.056887:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940569.057110:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940569.058601:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944818176 00000100:00100000:1.0:1788940569.058616:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944818176 00000100:00100000:1.0:1788940569.058678:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788940569.058687:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944818176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940569.058845:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944818176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (1956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940569.058853:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788940569.058973:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08587100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944818176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940569.060094:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08584700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10358:1875839944818304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940569.060168:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940569.060216:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49000 going to sleep for 11 seconds 00000100:00100000:3.0:1788940569.060303:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944818304 00000100:00100000:3.0:1788940569.060310:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944818304 00000100:00100000:3.0:1788940569.060362:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788940569.060371:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:10358:x1875839944818304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940569.060498:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:10358:x1875839944818304:12345-0@lo:502:llog_process_th.0 Request processed in 128us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940569.060506:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788940569.062200:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08584700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10358:1875839944818304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940569.062316:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08584700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10358:1875839944818432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940569.062440:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940569.062478:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940569.063125:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944818432 00000100:00100000:2.0:1788940569.063135:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944818432 00000100:00100000:2.0:1788940569.063195:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788940569.063206:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:10358:x1875839944818432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940569.063878:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:10358:x1875839944818432:12345-0@lo:502:llog_process_th.0 Request processed in 672us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940569.063896:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788940569.064055:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08584700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10358:1875839944818432:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788940569.064100:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788940569.064360:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788940569.064384:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788940569.064395:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053000/0x9c34acc08badd194 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd19b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940569.064408:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d042053000/0x9c34acc08badd194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd19b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940569.064419:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788940569.064429:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1788940569.064432:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788940569.064466:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0027f6600/0x9c34acc08badd1a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940569.064474:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d0027f6600/0x9c34acc08badd1a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940569.064484:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d0027f6600/0x9c34acc08badd1a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940569.064505:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944818560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788940569.064543:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940569.064581:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d002a69f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940569.064630:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944818560 00000100:00100000:1.0:1788940569.064636:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944818560 00000100:00100000:1.0:1788940569.064679:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788940569.064688:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944818560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940569.064700:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940569.064713:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaab200/0x9c34acc08badd1a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd1a2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.064748:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaab200/0x9c34acc08badd1a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd1a2 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.064759:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaab200/0x9c34acc08badd1a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd1a2 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.064768:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaab200, rc 0) 00000100:00100000:1.0:1788940569.064812:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944818560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940569.064819:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788940569.065180:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944818560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940569.065197:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d0027f6600/0x9c34acc08badd1a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd1a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940569.065207:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d0027f6600/0x9c34acc08badd1a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd1a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940569.065795:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08585c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944818688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940569.065836:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940569.065877:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940569.066159:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944818688 00000100:00100000:1.0:1788940569.066167:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944818688 00000100:00100000:1.0:1788940569.066217:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788940569.066225:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944818688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940569.066420:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944818688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940569.066427:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788940569.066550:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08585c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944818688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940569.066588:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08585c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944818816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940569.066715:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940569.066747:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940569.066790:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944818816 00000100:00100000:0.0:1788940569.066795:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944818816 00000100:00100000:0.0:1788940569.066833:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788940569.066840:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944818816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940569.066933:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944818816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940569.066940:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788940569.067017:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08585c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944818816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940569.067624:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10359:1875839944818944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940569.067666:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940569.067700:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d002a69b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940569.067814:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944818944 00000100:00100000:0.0:1788940569.067819:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944818944 00000100:00100000:0.0:1788940569.067862:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788940569.067869:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:10359:x1875839944818944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940569.067974:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:10359:x1875839944818944:12345-0@lo:502:llog_process_th.0 Request processed in 105us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940569.067982:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788940569.069963:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10359:1875839944818944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788940569.070026:0:10359:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940569.070039:0:10359:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940569.070041:0:10359:0:(obd_config.c:1662:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788940569.070046:0:10359:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788940569.070087:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08585180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10359:1875839944819072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940569.070151:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940569.070207:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944819072 00000100:00100000:0.0:1788940569.070216:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944819072 00000100:00100000:0.0:1788940569.070311:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788940569.070320:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:10359:x1875839944819072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940569.070434:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:10359:x1875839944819072:12345-0@lo:502:llog_process_th.0 Request processed in 114us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940569.070441:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788940569.071381:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940569.071409:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08585180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10359:1875839944819072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940569.071438:0:10359:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940569.071445:0:10359:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940569.071447:0:10359:0:(obd_config.c:1662:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788940569.071451:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1788940569.071622:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1788940569.071645:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788940569.071656:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0027f6600/0x9c34acc08badd1a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd1a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940569.071679:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d0027f6600/0x9c34acc08badd1a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd1a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940569.071689:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788940569.071691:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91d004f4a000 from 48 10000000:01000000:2.0:1788940569.071693:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788940569.071722:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053400/0x9c34acc08badd1b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940569.071730:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d042053400/0x9c34acc08badd1b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940569.071739:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d042053400/0x9c34acc08badd1b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940569.071757:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08585f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944819200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940569.071800:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940569.071832:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49540 going to sleep for 11 seconds 00000100:00100000:3.0:1788940569.071881:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944819200 00000100:00100000:3.0:1788940569.071887:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944819200 00000100:00100000:3.0:1788940569.071920:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788940569.071934:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944819200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940569.071946:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940569.071958:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0027f7600/0x9c34acc08badd1b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd1b0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940569.071978:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0027f7600/0x9c34acc08badd1b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd1b0 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940569.071987:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0027f7600/0x9c34acc08badd1b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd1b0 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940569.071996:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f7600, rc 0) 00000100:00100000:3.0:1788940569.072038:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944819200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940569.072044:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788940569.072152:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08585f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944819200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940569.072164:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d042053400/0x9c34acc08badd1b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd1b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940569.072173:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d042053400/0x9c34acc08badd1b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd1b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940569.072223:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08585f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944819328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940569.072247:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940569.072311:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49540 going to sleep for 11 seconds 00000100:00100000:1.0:1788940569.072366:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944819328 00000100:00100000:1.0:1788940569.072372:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944819328 00000100:00100000:1.0:1788940569.072402:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788940569.072408:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944819328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940569.072514:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944819328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940569.072520:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788940569.072723:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08585f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944819328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940569.072750:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08585f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944819456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940569.072788:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940569.072817:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940569.072830:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944819456 00000100:00100000:2.0:1788940569.072833:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944819456 00000100:00100000:2.0:1788940569.072851:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788940569.072857:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944819456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940569.072937:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944819456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940569.072944:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788940569.073023:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08585f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944819456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940569.073633:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10360:1875839944819584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940569.073677:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940569.073704:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d002a69000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940569.073750:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944819584 00000100:00100000:2.0:1788940569.073755:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944819584 00000100:00100000:2.0:1788940569.073790:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788940569.073797:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:10360:x1875839944819584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940569.073895:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:10360:x1875839944819584:12345-0@lo:502:llog_process_th.0 Request processed in 98us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940569.073902:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788940569.073997:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10360:1875839944819584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940569.074035:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10360:1875839944819712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940569.074077:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940569.074096:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02e8bd000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940569.074237:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944819712 00000100:00100000:0.0:1788940569.074241:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944819712 00000100:00100000:0.0:1788940569.074298:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788940569.074306:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:10360:x1875839944819712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940569.074389:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:10360:x1875839944819712:12345-0@lo:502:llog_process_th.0 Request processed in 84us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940569.074397:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788940569.074626:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10360:1875839944819712:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788940569.074645:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788940569.074895:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788940569.074917:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788940569.074932:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053400/0x9c34acc08badd1b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd1b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940569.074943:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d042053400/0x9c34acc08badd1b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd1b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940569.074952:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788940569.074955:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1788940569.074958:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788940569.074984:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd1be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940569.074991:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd1be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940569.075000:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd1be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940569.075015:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944819840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940569.075048:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940569.075142:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359e2000 going to sleep for 11 seconds 00000100:00100000:3.0:1788940569.075183:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944819840 00000100:00100000:3.0:1788940569.075188:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944819840 00000100:00100000:3.0:1788940569.075222:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788940569.075229:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944819840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940569.075238:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940569.075249:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0027f6a00/0x9c34acc08badd1c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd1be expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940569.075295:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0027f6a00/0x9c34acc08badd1c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd1be expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940569.075304:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0027f6a00/0x9c34acc08badd1c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd1be expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940569.075312:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f6a00, rc 0) 00000100:00100000:3.0:1788940569.075357:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944819840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940569.075363:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788940569.075471:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944819840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940569.075483:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd1be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd1c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940569.075491:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd1be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd1c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940569.075547:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944819968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940569.075579:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940569.075593:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359e2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940569.075637:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944819968 00000100:00100000:2.0:1788940569.075642:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944819968 00000100:00100000:2.0:1788940569.075670:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788940569.075676:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944819968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940569.075789:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944819968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940569.075796:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788940569.076024:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944819968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940569.076053:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944820096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940569.076155:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940569.076233:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359e2000 going to sleep for 11 seconds 00000100:00100000:1.0:1788940569.079395:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944820096 00000100:00100000:1.0:1788940569.079412:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944820096 00000100:00100000:1.0:1788940569.079499:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788940569.080124:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944820096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940569.080456:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944820096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 946us (4298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940569.080466:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788940569.083386:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944820096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940569.086729:0:10361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10361:1875839944820224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940569.086826:0:10361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940569.086868:0:10361:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d002a69000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940569.086972:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944820224 00000100:00100000:2.0:1788940569.086980:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944820224 00000100:00100000:2.0:1788940569.087033:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788940569.087043:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:10361:x1875839944820224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940569.087205:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:10361:x1875839944820224:12345-0@lo:502:llog_process_th.0 Request processed in 162us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940569.087213:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788940569.087451:0:10361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10361:1875839944820224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940569.087485:0:10361:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940569.087494:0:10361:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940569.087496:0:10361:0:(obd_config.c:1662:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788940569.087502:0:10361:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788940569.087539:0:10361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10361:1875839944820352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940569.087579:0:10361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940569.087601:0:10361:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359e2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940569.087712:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944820352 00000100:00100000:2.0:1788940569.087717:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944820352 00000100:00100000:2.0:1788940569.087749:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788940569.087757:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:10361:x1875839944820352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940569.087832:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:10361:x1875839944820352:12345-0@lo:502:llog_process_th.0 Request processed in 75us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940569.087839:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788940569.087937:0:10361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10361:1875839944820352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940569.087955:0:10361:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940569.087959:0:10361:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940569.087961:0:10361:0:(obd_config.c:1662:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788940569.087965:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788940569.088204:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1788940569.088226:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788940569.088237:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd1be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd1c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940569.088249:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd1be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd1c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940569.088290:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788940569.088293:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91d00509b3b0 from 1 10000000:01000000:2.0:1788940569.088296:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788940569.088334:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e6600/0x9c34acc08badd1cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940569.088372:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d0355e6600/0x9c34acc08badd1cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940569.088389:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d0355e6600/0x9c34acc08badd1cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940569.088404:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08587480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944820480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940569.088435:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940569.088455:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49600 going to sleep for 11 seconds 00000100:00100000:1.0:1788940569.088531:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944820480 00000100:00100000:1.0:1788940569.088536:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944820480 00000100:00100000:1.0:1788940569.088570:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788940569.088578:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944820480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940569.088587:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940569.088599:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaab800/0x9c34acc08badd1d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd1cc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.088621:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaab800/0x9c34acc08badd1d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd1cc expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.088632:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaab800/0x9c34acc08badd1d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd1cc expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940569.088639:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaab800, rc 0) 00000100:00100000:1.0:1788940569.088675:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944820480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940569.088681:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788940569.088880:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08587480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944820480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940569.088895:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d0355e6600/0x9c34acc08badd1cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd1d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940569.088904:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d0355e6600/0x9c34acc08badd1cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd1d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940569.088960:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944820608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940569.088988:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940569.089008:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359e2000 going to sleep for 11 seconds 00000100:00100000:1.0:1788940569.089074:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944820608 00000100:00100000:1.0:1788940569.089078:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944820608 00000100:00100000:1.0:1788940569.089107:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788940569.089114:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944820608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940569.089181:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944820608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (192us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788940569.089194:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788940569.089436:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944820608:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788940569.089461:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788940569.089466:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e6600/0x9c34acc08badd1cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd1d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940569.089473:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d0355e6600/0x9c34acc08badd1cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd1d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940569.243498:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940569.243535:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944820736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788940569.243617:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940569.243804:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944820736 00000100:00100000:0.0:1788940569.243813:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944820736 00000100:00100000:0.0:1788940569.243861:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788940569.243871:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944820736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788940569.243904:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788940569.244001:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944820736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940569.244009:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788940569.244281:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944820736:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788940569.883586:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940570.267871:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944820864:0@lo:400:kworker.0 00000100:00100000:2.0:1788940570.267962:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940570.268019:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944821376:0@lo:400:kworker.0 00000100:00100000:2.0:1788940570.268047:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940570.268179:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944821120:0@lo:400:kworker.0 00000100:00100000:1.0:1788940570.268271:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944820864 00000100:00100000:1.0:1788940570.268280:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944820864 00000100:00100000:1.0:1788940570.268340:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788940570.268350:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944820864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940570.268402:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944820864:12345-0@lo:400:kworker.0 Request processed in 53us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940570.268409:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788940570.268457:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944820992:0@lo:400:kworker.0 00000100:00100000:1.0:1788940570.268490:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940570.268510:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944821504:0@lo:400:kworker.0 00000100:00100000:1.0:1788940570.268534:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940570.268560:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944822016:0@lo:400:kworker.0 00000100:00100000:1.0:1788940570.268581:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940570.268598:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944822528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788940570.268620:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940570.268652:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944820992 00000100:00100000:1.0:1788940570.268656:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944820992 00000100:00100000:1.0:1788940570.268682:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944821504 00000100:00100000:1.0:1788940570.268685:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944821504 00000100:00100000:1.0:1788940570.268708:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944822016 00000100:00100000:1.0:1788940570.268711:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944822016 00000100:00100000:1.0:1788940570.268791:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788940570.268800:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944820992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940570.268838:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944820992:12345-0@lo:400:kworker.0 Request processed in 39us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940570.268853:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788940570.268867:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788940570.268873:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944821504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940570.268902:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944821504:12345-0@lo:400:kworker.0 Request processed in 30us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940570.268907:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788940570.268918:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788940570.268923:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944822016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940570.268949:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944822016:12345-0@lo:400:kworker.0 Request processed in 26us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940570.268954:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788940570.268970:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944822528 00000100:00100000:1.0:1788940570.268973:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944822528 00000100:00100000:1.0:1788940570.268999:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788940570.269004:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944822528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788940570.269038:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940570.269162:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944821248:0@lo:400:kworker.0 00000100:00100000:0.0:1788940570.269192:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940570.269211:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944821760:0@lo:400:kworker.0 00000100:00100000:0.0:1788940570.269232:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940570.269274:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944822272:0@lo:400:kworker.0 00000100:00100000:0.0:1788940570.269297:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940570.269316:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940570.269322:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944822656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940570.269354:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940570.269381:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944821760 00000100:00100000:0.0:1788940570.269384:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944821760 00000100:00100000:0.0:1788940570.269411:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944822272 00000100:00100000:0.0:1788940570.269413:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944822272 00000100:00100000:0.0:1788940570.269429:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788940570.269434:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944821760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940570.269468:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944821760:12345-0@lo:400:kworker.0 Request processed in 33us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940570.269474:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788940570.269489:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788940570.269495:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1875839944822272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940570.269521:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1875839944822272:12345-0@lo:400:kworker.0 Request processed in 27us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940570.269527:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788940570.269567:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d037850380 x1875839944821760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940570.269582:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944821760:0@lo:400:kworker.0 00010000:00080000:0.0:1788940570.269593:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d037850e00 x1875839944822272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940570.269601:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944822272:0@lo:400:kworker.0 00000100:00080000:0.0:1788940570.269633:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940570.269643:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940570.269646:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940570.269666:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944820992:0@lo:400:kworker.0 00000100:00100000:0.0:1788940570.269677:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944821504:0@lo:400:kworker.0 00000100:00100000:0.0:1788940570.269686:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944822016:0@lo:400:kworker.0 00000100:00100000:0.0:1788940570.269713:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944821248 00000100:00100000:0.0:1788940570.269717:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944821248 00000100:00100000:0.0:1788940570.269816:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788940570.269823:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944821248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940570.269861:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944821248:12345-0@lo:400:kworker.0 Request processed in 39us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940570.269868:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788940570.269895:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944821248:0@lo:400:kworker.0 00000100:00100000:0.0:1788940570.269917:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944822656 00000100:00100000:0.0:1788940570.269920:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944822656 00000100:00100000:0.0:1788940570.269941:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788940570.269946:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944822656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940570.269957:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940570.269988:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944822656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940570.269995:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788940570.270013:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788940570.270033:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0359d4000 x1875839944822656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940570.270048:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944822656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940570.270225:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944822528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1219us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940570.270232:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788940570.270390:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944821888:0@lo:400:kworker.0 00000100:00100000:2.0:1788940570.270415:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940570.270429:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944822400:0@lo:400:kworker.0 00000100:00100000:2.0:1788940570.270444:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940570.270466:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944820864:0@lo:400:kworker.0 00000100:00100000:2.0:1788940570.270486:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944821376 00000100:00100000:2.0:1788940570.270490:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944821376 00000100:00100000:2.0:1788940570.270518:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788940570.270526:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944821376:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788940570.270542:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ff3480 x1875839944822528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940570.270559:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944822528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940570.270581:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944821376:12345-0@lo:400:kworker.0 Request processed in 54us (2530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940570.270589:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788940570.270592:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944821888 00000100:00100000:3.0:1788940570.270598:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944821888 00000100:00100000:2.0:1788940570.270623:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944821376:0@lo:400:kworker.0 00000100:00100000:3.0:1788940570.270639:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944822400 00000100:00100000:3.0:1788940570.270644:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944822400 00000100:00100000:2.0:1788940570.270655:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788940570.270665:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944821888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940570.270680:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788940570.270691:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944822400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940570.270702:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944821888:12345-0@lo:400:kworker.0 Request processed in 39us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940570.270709:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788940570.270735:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944822400:12345-0@lo:400:kworker.0 Request processed in 47us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940570.270742:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788940570.270832:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940570.271303:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940570.271354:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944821632:0@lo:400:kworker.0 00000100:00100000:1.0:1788940570.271390:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940570.271423:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944822144:0@lo:400:kworker.0 00000100:00100000:1.0:1788940570.271445:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940570.271475:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944821632 00000100:00100000:1.0:1788940570.271487:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944821632 00000100:00100000:1.0:1788940570.271516:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944822144 00000100:00100000:1.0:1788940570.271519:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944822144 00000100:00100000:1.0:1788940570.271541:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788940570.271547:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944821632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940570.271585:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944821632:12345-0@lo:400:kworker.0 Request processed in 38us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940570.271591:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788940570.271605:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788940570.271610:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944822144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940570.271637:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944822144:12345-0@lo:400:kworker.0 Request processed in 27us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940570.271642:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788940570.271660:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788940570.271686:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d037851500 x1875839944821632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940570.271699:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944821632:0@lo:400:kworker.0 00010000:00080000:1.0:1788940570.271709:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d037850a80 x1875839944822144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940570.271716:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944822144:0@lo:400:kworker.0 00010000:00080000:2.0:1788940570.273041:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d037853800 x1875839944821888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940570.273230:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944821120 00000100:00100000:0.0:1788940570.273237:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944821120 00000100:00100000:0.0:1788940570.273308:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788940570.273317:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944821120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940570.273390:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944821120:12345-0@lo:400:kworker.0 Request processed in 74us (2087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940570.273399:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788940570.273803:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944821888:0@lo:400:kworker.0 00010000:00080000:2.0:1788940570.273824:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d037850000 x1875839944822400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940570.273835:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944822400:0@lo:400:kworker.0 00000100:00100000:1.0:1788940570.274121:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944821120:0@lo:400:kworker.0 00010000:00010000:3.0:1788940570.910916:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940571.931616:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940572.828598:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940572.828634:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944822784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788940572.828728:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940572.829469:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944822784 00000100:00100000:1.0:1788940572.829478:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944822784 00000100:00100000:1.0:1788940572.829534:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788940572.829554:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944822784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788940572.829614:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788940572.829672:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944822784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940572.829678:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788940572.829735:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944822784:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788940572.957180:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940573.341345:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788940573.341370:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944823040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940573.341443:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940573.341513:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944822912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940573.341536:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940573.341602:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944823040 00000100:00100000:3.0:1788940573.341610:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944822912 00000100:00100000:1.0:1788940573.341611:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944823040 00000100:00100000:3.0:1788940573.341614:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944822912 00000100:00100000:3.0:1788940573.341691:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788940573.341732:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940573.342323:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788940573.342333:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944823040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940573.342363:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940573.342414:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944823040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940573.342421:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788940573.346354:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08585180 x1875839944823040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940573.346382:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944823040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940573.352420:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944822912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788940573.352460:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940573.352560:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944822912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10860us (11022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940573.352569:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788940573.356442:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ff2300 x1875839944822912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940573.356493:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944822912:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788940573.981169:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940573.991197:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940573.991287:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940573.991345:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940573.991377:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940573.991400:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940573.991565:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921690112 00000100:00100000:3.0:1788940573.991576:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921690112 00000100:00100000:3.0:1788940573.991636:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 247 00000100:00100000:3.0:1788940573.991646:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+8:6193:x1875839921690112:12345-192.168.202.25@tcp:101: 00010000:00010000:3.0:1788940573.991663:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940573.991682:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0027f7400/0x9c34acc08badd1da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc714f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940573.991710:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0027f7400/0x9c34acc08badd1da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc714f expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940573.991722:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0027f7400/0x9c34acc08badd1da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc714f expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940573.991749:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f7400, rc 0) 00000100:00100000:3.0:1788940573.991811:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+9:6193:x1875839921690112:12345-192.168.202.25@tcp:101: Request processed in 166us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940573.991818:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 247 00000100:00100000:3.0:1788940573.991854:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921690624 00000100:00100000:3.0:1788940573.991857:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921690624 00000100:00100000:3.0:1788940573.991894:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921690496 00000100:00100000:3.0:1788940573.991897:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921690496 00000100:00100000:3.0:1788940573.991919:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:3.0:1788940573.991926:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921690624:12345-192.168.202.25@tcp:400: 00000100:00100000:3.0:1788940573.991956:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921690624:12345-192.168.202.25@tcp:400: Request processed in 31us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940573.991963:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:3.0:1788940573.991974:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:3.0:1788940573.991981:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921690496:12345-192.168.202.25@tcp:400: 00000100:00100000:3.0:1788940573.992005:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921690496:12345-192.168.202.25@tcp:400: Request processed in 24us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940573.992010:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00080000:3.0:1788940573.992032:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940573.992036:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940573.992167:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921690368 00000100:00100000:1.0:1788940573.992172:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921690368 00000100:00100000:1.0:1788940573.992217:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921690240 00000100:00100000:1.0:1788940573.992220:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921690240 00000100:00100000:1.0:1788940573.992242:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 80 00000100:00100000:1.0:1788940573.992250:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921690368:12345-192.168.202.25@tcp:400: 00000100:00100000:1.0:1788940573.992317:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921690368:12345-192.168.202.25@tcp:400: Request processed in 68us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940573.992324:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 81 00000100:00100000:2.0:1788940573.992333:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2405:x1875839921690240:12345-192.168.202.25@tcp:400: 00000100:00080000:3.0:1788940573.992362:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940573.992365:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788940573.992365:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2405:x1875839921690240:12345-192.168.202.25@tcp:400: Request processed in 35us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940574.000891:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940574.005626:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921690752 00000100:00100000:0.0:1788940574.005645:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921690752 00000100:00100000:0.0:1788940574.005728:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 248 00000100:00100000:0.0:1788940574.005739:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+9:6193:x1875839921690752:12345-192.168.202.25@tcp:501: 00000100:00100000:0.0:1788940574.005929:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+9:6193:x1875839921690752:12345-192.168.202.25@tcp:501: Request processed in 191us (5048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940574.005936:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 248 00000100:00100000:1.0:1788940574.013236:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 80 00000100:00100000:3.0:1788940574.013706:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940574.014489:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921690880 00000100:00100000:1.0:1788940574.014501:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921690880 00000100:00100000:1.0:1788940574.014564:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 249 00000100:00100000:1.0:1788940574.014575:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+9:6193:x1875839921690880:12345-192.168.202.25@tcp:503: 00000100:00100000:1.0:1788940574.014755:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+9:6193:x1875839921690880:12345-192.168.202.25@tcp:503: Request processed in 181us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940574.014764:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 249 00000100:00100000:0.0:1788940574.021801:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940574.022359:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921691008 00000100:00100000:3.0:1788940574.022404:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921691008 00000100:00100000:3.0:1788940574.022490:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 250 00000100:00100000:3.0:1788940574.022503:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+9:6699:x1875839921691008:12345-192.168.202.25@tcp:502: 00000100:00100000:3.0:1788940574.022936:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+9:6699:x1875839921691008:12345-192.168.202.25@tcp:502: Request processed in 434us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940574.022946:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 250 00000100:00100000:2.0:1788940574.024366:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 81 00000100:00100000:3.0:1788940574.026733:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940574.026919:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921691136 00000100:00100000:0.0:1788940574.026933:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921691136 00000100:00100000:0.0:1788940574.027056:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 251 00000100:00100000:0.0:1788940574.027070:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+9:6699:x1875839921691136:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940574.027346:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+9:6699:x1875839921691136:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 279us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940574.027362:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 251 00000100:00100000:3.0:1788940574.033192:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940574.037508:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921691264 00000100:00100000:1.0:1788940574.037534:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921691264 00000100:00100000:3.0:1788940574.037760:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 252 00000100:00100000:3.0:1788940574.037774:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+9:6193:x1875839921691264:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940574.037799:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940574.037829:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0027f6000/0x9c34acc08badd1e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7156 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940574.037876:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0027f6000/0x9c34acc08badd1e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7156 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940574.037890:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0027f6000/0x9c34acc08badd1e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7156 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940574.037900:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f6000, rc 0) 00000100:00100000:3.0:1788940574.038001:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6193:x1875839921691264:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 Request processed in 229us (4825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940574.038008:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 252 00000100:00100000:3.0:1788940574.040948:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940574.041059:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921691392 00000100:00100000:0.0:1788940574.041074:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921691392 00000100:00100000:0.0:1788940574.041146:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 253 00000100:00100000:0.0:1788940574.041159:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6193:x1875839921691392:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940574.041352:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6193:x1875839921691392:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 Request processed in 196us (422us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940574.041361:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 253 00000100:00100000:2.0:1788940574.363834:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944823168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788940574.363936:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940574.363989:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944823168 00000100:00100000:3.0:1788940574.364000:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944823168 00000100:00100000:3.0:1788940574.364775:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788940574.364799:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944823168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788940574.364846:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788940574.365001:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944823168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 213us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940574.365009:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788940574.365122:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944823168:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788940575.007649:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940575.391586:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944823296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940575.391700:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940575.392195:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944823552:0@lo:400:kworker.0 00000100:00100000:0.0:1788940575.392240:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940575.392294:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944824064:0@lo:400:kworker.0 00000100:00100000:0.0:1788940575.392318:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940575.392336:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944824576:0@lo:400:kworker.0 00000100:00100000:0.0:1788940575.392357:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940575.392378:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788940575.392384:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944823680:0@lo:400:kworker.0 00000100:00100000:0.0:1788940575.392414:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940575.392433:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944824192:0@lo:400:kworker.0 00000100:00100000:0.0:1788940575.392455:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940575.392471:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944824704:0@lo:400:kworker.0 00000100:00100000:0.0:1788940575.392516:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940575.392557:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944823552 00000100:00100000:0.0:1788940575.392568:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944823552 00000100:00100000:0.0:1788940575.392622:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944824064 00000100:00100000:0.0:1788940575.392625:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944824064 00000100:00100000:0.0:1788940575.392652:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944824576 00000100:00100000:0.0:1788940575.392654:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944824576 00000100:00100000:0.0:1788940575.392668:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944824192 00000100:00100000:0.0:1788940575.392670:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944824192 00000100:00100000:0.0:1788940575.392681:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944824704 00000100:00100000:0.0:1788940575.392683:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944824704 00000100:00100000:0.0:1788940575.392698:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788940575.392706:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944823552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940575.392785:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944823552:12345-0@lo:400:kworker.0 Request processed in 78us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940575.392793:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788940575.392816:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788940575.392822:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944824064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940575.393105:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944824064:12345-0@lo:400:kworker.0 Request processed in 282us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940575.393113:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788940575.393128:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788940575.393135:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944824576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940575.393163:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944824576:12345-0@lo:400:kworker.0 Request processed in 29us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940575.393169:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788940575.393180:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788940575.393186:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944824192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940575.393224:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944824192:12345-0@lo:400:kworker.0 Request processed in 38us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940575.393230:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788940575.393243:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788940575.393249:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944824704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940575.393311:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944824704:12345-0@lo:400:kworker.0 Request processed in 62us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940575.393317:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788940575.393356:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788940575.393362:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788940575.393396:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a53b80 x1875839944824192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940575.393412:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944824192:0@lo:400:kworker.0 00010000:00080000:0.0:1788940575.393425:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0359fad80 x1875839944824704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940575.393433:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944824704:0@lo:400:kworker.0 00000100:00100000:0.0:1788940575.393444:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944823552:0@lo:400:kworker.0 00000100:00100000:0.0:1788940575.393454:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944824064:0@lo:400:kworker.0 00000100:00100000:0.0:1788940575.393463:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944824576:0@lo:400:kworker.0 00000100:00100000:1.0:1788940575.393655:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944823424:0@lo:400:kworker.0 00000100:00100000:1.0:1788940575.393696:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940575.393738:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944823936:0@lo:400:kworker.0 00000100:00100000:1.0:1788940575.393776:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940575.393802:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944824448:0@lo:400:kworker.0 00000100:00100000:1.0:1788940575.393824:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940575.393859:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788940575.393865:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944823808:0@lo:400:kworker.0 00000100:00100000:1.0:1788940575.393885:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940575.393900:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944824320:0@lo:400:kworker.0 00000100:00100000:1.0:1788940575.393917:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940575.393934:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944824832:0@lo:400:kworker.0 00000100:00100000:1.0:1788940575.393955:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940575.393993:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944823680 00000100:00100000:1.0:1788940575.393998:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944823680 00000100:00100000:1.0:1788940575.394043:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944823936 00000100:00100000:1.0:1788940575.394046:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944823936 00000100:00100000:1.0:1788940575.394059:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788940575.394065:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944823680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940575.394117:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944823680:12345-0@lo:400:kworker.0 Request processed in 52us (1702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940575.394124:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788940575.394136:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788940575.394141:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944823936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940575.394166:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944823936:12345-0@lo:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940575.394172:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788940575.394190:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944824448 00000100:00100000:1.0:1788940575.394193:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944824448 00000100:00100000:1.0:1788940575.394226:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944824320 00000100:00100000:1.0:1788940575.394228:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944824320 00000100:00100000:1.0:1788940575.394239:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944824832 00000100:00100000:1.0:1788940575.394241:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944824832 00000100:00100000:1.0:1788940575.394294:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788940575.394303:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944824448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940575.394335:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944824448:12345-0@lo:400:kworker.0 Request processed in 34us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940575.394341:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788940575.394351:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788940575.394357:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944824320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940575.394383:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944824320:12345-0@lo:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940575.394389:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788940575.394399:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788940575.394404:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944824832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940575.394442:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944824832:12345-0@lo:400:kworker.0 Request processed in 37us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940575.394448:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788940575.394483:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940575.394487:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940575.394518:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a51880 x1875839944824320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940575.394530:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944824320:0@lo:400:kworker.0 00010000:00080000:1.0:1788940575.394540:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0359fa680 x1875839944824832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940575.394549:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944824832:0@lo:400:kworker.0 00000100:00100000:1.0:1788940575.394558:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944823936:0@lo:400:kworker.0 00010000:00080000:1.0:1788940575.394567:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a50a80 x1875839944824448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940575.394575:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944824448:0@lo:400:kworker.0 00000100:00100000:1.0:1788940575.394615:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944823680:0@lo:400:kworker.0 00000100:00100000:1.0:1788940575.394635:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944823808 00000100:00100000:1.0:1788940575.394638:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944823808 00000100:00100000:1.0:1788940575.394667:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788940575.394673:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944823808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940575.394709:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944823808:12345-0@lo:400:kworker.0 Request processed in 36us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940575.394715:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788940575.394751:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944823808:0@lo:400:kworker.0 00000100:00100000:0.0:1788940575.395232:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944823424 00000100:00100000:0.0:1788940575.395239:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944823424 00000100:00100000:0.0:1788940575.395312:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788940575.395321:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944823424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940575.395382:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944823424:12345-0@lo:400:kworker.0 Request processed in 63us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940575.395389:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788940575.395699:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944823424:0@lo:400:kworker.0 00000100:00100000:2.0:1788940575.395944:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944823296 00000100:00100000:2.0:1788940575.395952:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944823296 00000100:00100000:2.0:1788940575.397298:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788940575.397312:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944823296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940575.397356:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940575.397449:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944823296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (5750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940575.397457:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788940575.397526:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d037850a80 x1875839944823296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940575.397550:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944823296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940575.397639:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944824960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940575.397683:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940575.397719:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944824960 00000100:00100000:2.0:1788940575.397726:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944824960 00000100:00100000:2.0:1788940575.397816:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788940575.397824:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944824960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788940575.397837:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940575.397866:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944824960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940575.397871:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788940575.397894:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08587800 x1875839944824960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940575.397905:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944824960:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788940575.399281:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1788940575.746626:0:10399:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3d42b160 20000000:00000080:3.0:1788940575.746652:0:10399:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91cf08583800 uarg=0000000000000000 20000000:01000000:3.0:1788940575.746721:0:10399:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788940575.746729:0:10399:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788940575.746737:0:10399:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788940575.748235:0:10400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788940575.751331:0:10399:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788940575.754850:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788940575.754887:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788940575.754901:0:10399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788940575.754920:0:10399:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788940575.754941:0:10399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d0027f6200/0x9c34acc08badd1e8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940575.754959:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d042053a00/0x9c34acc08badce84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badce7d expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940575.754966:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d042052000/0x9c34acc08badce92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badce8b expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940575.754972:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d0421c0800/0x9c34acc08badcee6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badcedf expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940575.754977:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584c800/0x9c34acc08badd00c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd005 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940575.754997:0:10399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd124 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7117 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940575.755005:0:10399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d0027f6200/0x9c34acc08badd1e8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940575.755045:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd124 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7117 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940575.755058:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd124 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7117 expref: 9 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940575.755071:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875839944825088:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940575.755191:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584c800/0x9c34acc08badd00c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badd005 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940575.755199:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584c800/0x9c34acc08badd00c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badd005 expref: 23 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940575.755208:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875839944825216:0@lo:104: 00000100:00100000:3.0:1788940575.755252:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940575.757041:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d0421c0800/0x9c34acc08badcee6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badcedf expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940575.757063:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d0421c0800/0x9c34acc08badcee6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badcedf expref: 23 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940575.757082:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875839944825344:0@lo:104: 00000100:00100000:3.0:1788940575.757170:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940575.757219:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d042052000/0x9c34acc08badce92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badce8b expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940575.757472:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d042052000/0x9c34acc08badce92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badce8b expref: 23 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940575.757490:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875839944825472:0@lo:104: 00010000:00010000:3.0:1788940575.757600:0:10399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d042053a00/0x9c34acc08badce84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badce7d expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940575.757613:0:10399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d042053a00/0x9c34acc08badce84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badce7d expref: 23 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940575.757627:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875839944825600:0@lo:104: 00000100:00100000:0.0:1788940575.757669:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788940575.757742:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940575.757778:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940575.757779:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944825216 00000100:00100000:0.0:1788940575.757793:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944825216 00000100:00100000:3.0:1788940575.757805:0:10399:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d018b66b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940575.757855:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944825344 00000100:00100000:0.0:1788940575.757860:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944825344 00000100:00100000:0.0:1788940575.757869:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944825472 00000100:00100000:0.0:1788940575.757871:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944825472 00000100:00100000:0.0:1788940575.757879:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944825600 00000100:00100000:0.0:1788940575.757881:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944825600 00000100:00100000:0.0:1788940575.757894:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788940575.757904:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+6:10399:x1875839944825216:12345-0@lo:104: 00010000:00010000:0.0:1788940575.758019:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd005 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd00c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940575.758112:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788940575.758119:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+6:10399:x1875839944825216:12345-0@lo:104: Request processed in 218us (2868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940575.758128:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788940575.758154:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788940575.758235:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06eca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+5:10399:x1875839944825344:12345-0@lo:104: 00010000:00010000:0.0:1788940575.758243:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d02eaab600/0x9c34acc08badcedf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcee6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940575.758318:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788940575.758335:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06eca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+5:10399:x1875839944825344:12345-0@lo:104: Request processed in 102us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940575.758342:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1788940575.758428:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940575.758441:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd005 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd00c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.758450:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaab000 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940575.758456:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd005 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badd00c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940575.758460:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1788940575.758467:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd005 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badd00c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940575.758471:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:10399:x1875839944825472:12345-0@lo:104: 10000000:00010000:1.0:1788940575.758477:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd005 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badd00c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940575.758481:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa200/0x9c34acc08badce8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badce92 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940575.758485:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788940575.758503:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875839944825216:0@lo:104: 00010000:00010000:0.0:1788940575.758527:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1788940575.758531:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd005 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd00c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940575.758539:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875839944825344:0@lo:104: 00000100:00100000:0.0:1788940575.758540:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:10399:x1875839944825472:12345-0@lo:104: Request processed in 67us (795us total) trans 0 rc 0/0 00010000:00010000:1.0:1788940575.758543:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788940575.758562:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1788940575.758574:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd005 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd00c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940575.758578:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875839944825472:0@lo:104: 00000100:00100000:0.0:1788940575.758583:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1788940575.758594:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd005 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd00c expref: -99 pid: 9515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940575.758600:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:10399:x1875839944825600:12345-0@lo:104: 00010000:00010000:0.0:1788940575.758607:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa800/0x9c34acc08badce7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badce84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.758612:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940575.758615:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02eaab600/0x9c34acc08badcedf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badcee6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.758628:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaab600 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940575.758631:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaab600/0x9c34acc08badcedf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badcee6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.758638:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02eaab600/0x9c34acc08badcedf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badcee6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940575.758645:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaab600/0x9c34acc08badcedf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badcee6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940575.758647:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:01000000:1.0:1788940575.758651:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788940575.758651:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:10399:x1875839944825600:12345-0@lo:104: Request processed in 56us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940575.758657:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1788940575.758666:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d02eaab600/0x9c34acc08badcedf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcee6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.758672:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940575.758674:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940575.758678:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02eaab600/0x9c34acc08badcedf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcee6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.758684:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02eaab600/0x9c34acc08badcedf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badcee6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.758692:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940575.758695:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa800/0x9c34acc08badce7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badce84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.758700:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaaa800 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940575.758704:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa800/0x9c34acc08badce7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badce84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.758719:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa800/0x9c34acc08badce7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badce84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940575.758725:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa800/0x9c34acc08badce7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badce84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940575.758730:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788940575.758765:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa800/0x9c34acc08badce7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.758771:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940575.758791:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa800/0x9c34acc08badce7d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.758798:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa800/0x9c34acc08badce7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce84 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.758808:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940575.758809:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940575.758811:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940575.758826:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944825728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940575.758875:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940575.758925:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940575.758932:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944825856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940575.758953:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940575.758981:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944825984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940575.759004:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940575.759038:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944825728 00000100:00100000:1.0:1788940575.759051:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944825728 00010000:00010000:1.0:1788940575.759079:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584c800/0x9c34acc08badd00c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd005 expref: 24 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940575.759100:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944825856 00000100:00100000:1.0:1788940575.759103:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944825856 00010000:00010000:1.0:1788940575.759113:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d0421c0800/0x9c34acc08badcee6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcedf expref: 25 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940575.759123:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944825984 00000100:00100000:1.0:1788940575.759125:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944825984 00010000:00010000:1.0:1788940575.759135:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d042053a00/0x9c34acc08badce84 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badce7d expref: 26 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940575.759151:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788940575.759159:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+26:3645:x1875839944825728:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940575.759175:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875839944825600:0@lo:104: 00010000:00010000:1.0:1788940575.759178:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940575.759187:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584c800/0x9c34acc08badd00c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd005 expref: 26 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.759200:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584c800/0x9c34acc08badd00c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badd005 expref: 26 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.759215:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584c800/0x9c34acc08badd00c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badd005 expref: 26 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.759230:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940575.759293:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+25:3645:x1875839944825728:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940575.759300:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788940575.759315:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788940575.759327:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037850a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944825856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940575.759335:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940575.759340:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d0421c0800/0x9c34acc08badcee6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badcedf expref: 24 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.759348:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d0421c0800/0x9c34acc08badcee6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badcedf expref: 24 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.759358:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0421c0800/0x9c34acc08badcee6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badcedf expref: 24 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.759368:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940575.759391:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037850a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:3645:x1875839944825856:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940575.759396:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788940575.759408:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788940575.759413:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:3647:x1875839944825984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940575.759420:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940575.759424:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d042053a00/0x9c34acc08badce84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badce7d expref: 22 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.759433:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d042053a00/0x9c34acc08badce84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badce7d expref: 22 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.759442:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d042053a00/0x9c34acc08badce84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badce7d expref: 22 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.759451:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940575.759475:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:3647:x1875839944825984:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940575.759489:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788940575.759530:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944825984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940575.759610:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944825856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940575.759624:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944825728:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940575.760047:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940575.760051:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940575.760053:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940575.760079:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa200/0x9c34acc08badce8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badce92 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940575.760092:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaaa200 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940575.760113:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa200/0x9c34acc08badce8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badce92 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940575.760125:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa200/0x9c34acc08badce8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badce92 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940575.760133:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa200/0x9c34acc08badce8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badce92 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940575.760140:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788940575.760189:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa200/0x9c34acc08badce8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce92 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940575.760196:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940575.760240:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa200/0x9c34acc08badce8b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce92 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940575.760251:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa200/0x9c34acc08badce8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badce92 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940575.760513:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944826112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940575.760579:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940575.761016:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940575.761018:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940575.761020:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940575.761165:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944826112 00000100:00100000:0.0:1788940575.761174:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944826112 00010000:00010000:0.0:1788940575.761207:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d042052000/0x9c34acc08badce92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badce8b expref: 21 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940575.761449:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788940575.761460:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050d8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:3648:x1875839944826112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940575.761484:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940575.761491:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d042052000/0x9c34acc08badce92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badce8b expref: 21 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940575.761502:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d042052000/0x9c34acc08badce92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badce8b expref: 21 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940575.761517:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d042052000/0x9c34acc08badce92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badce8b expref: 21 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940575.761533:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940575.761578:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050d8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:3648:x1875839944826112:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940575.761586:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788940575.761696:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944826112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940575.762493:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10399:1875839944825088:192.168.202.25@tcp:104: 00010000:00010000:2.0:1788940575.762527:0:10399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d0027f6200/0x9c34acc08badd1e8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940575.763006:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940575.763243:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921691520 00000100:00100000:1.0:1788940575.763252:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921691520 00010000:00010000:1.0:1788940575.763533:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd124 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7117 expref: 10 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940575.763575:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00100000:1.0:1788940575.763585:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2404:x1875839921691520:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940575.763598:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940575.763603:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd124 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7117 expref: 10 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.763615:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd124 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7117 expref: 10 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.763631:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd124 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7117 expref: 10 pid: 6515 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.763645:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d0027f6200/0x9c34acc08badd1e8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.763663:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0027f6200/0x9c34acc08badd1e8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.763691:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d0027f6200/0x9c34acc08badd1e8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.763698:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d0027f6200/0x9c34acc08badd1e8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.763705:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d0027f6200/0x9c34acc08badd1e8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.763711:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d0027f6200/0x9c34acc08badd1e8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.763717:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940575.763722:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d0027f6200/0x9c34acc08badd1e8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.763730:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d0027f6200/0x9c34acc08badd1e8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.763740:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d0027f6200/0x9c34acc08badd1e8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.763749:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940575.763813:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+9:2404:x1875839921691520:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 230us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940575.763820:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 39 00010000:00010000:2.0:1788940575.763932:0:10399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d0027f6200/0x9c34acc08badd1e8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940575.763941:0:10399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d0027f6200/0x9c34acc08badd1e8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940575.763948:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0027f6200/0x9c34acc08badd1e8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940575.861481:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940575.861904:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921691648 00000100:00100000:1.0:1788940575.861917:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921691648 00000100:00100000:1.0:1788940575.862726:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 255 00000100:00100000:1.0:1788940575.862736:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+9:6193:x1875839921691648:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940575.862764:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940575.862781:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaaa800/0x9c34acc08badd1ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc715d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.862804:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaaa800/0x9c34acc08badd1ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc715d expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.862812:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaaa800/0x9c34acc08badd1ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc715d expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940575.862818:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaaa800, rc 0) 00000100:00100000:1.0:1788940575.862874:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6193:x1875839921691648:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 Request processed in 141us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940575.862879:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 255 00000100:00100000:0.0:1788940575.879053:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940575.879223:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921691776 00000100:00100000:1.0:1788940575.879889:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921691776 00000100:00100000:1.0:1788940575.879991:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 256 00000100:00100000:1.0:1788940575.880002:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6193:x1875839921691776:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940575.880180:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6193:x1875839921691776:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 Request processed in 179us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940575.880188:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 256 00000100:00100000:0.0:1788940575.895382:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940575.895611:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921691904 00000100:00100000:1.0:1788940575.895623:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921691904 00000100:00100000:1.0:1788940575.895700:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 257 00000100:00100000:1.0:1788940575.895712:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6193:x1875839921691904:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940575.895878:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6193:x1875839921691904:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 Request processed in 169us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940575.895894:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 257 00000100:00100000:0.0:1788940575.899997:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940575.900081:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921692032 00000100:00100000:1.0:1788940575.900093:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921692032 00000100:00100000:1.0:1788940575.900169:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 258 00000100:00100000:1.0:1788940575.900179:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6724:x1875839921692032:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788940575.900399:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6724:x1875839921692032:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 220us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940575.900408:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 258 00000100:00100000:0.0:1788940575.906515:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940575.906728:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921692160 00000100:00100000:3.0:1788940575.906745:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921692160 00000100:00100000:3.0:1788940575.906823:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 259 00000100:00100000:3.0:1788940575.906840:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6724:x1875839921692160:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788940575.908407:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:6724:x1875839921692160:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 1558us (1887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940575.908439:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 259 00010000:00010000:0.0:1788940576.034012:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940577.051673:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788940577.245342:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788940577.245352:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d037817800 from 4 10000000:01000000:0.0:1788940577.245358:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788940577.245404:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd1f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940577.245427:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd1f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940577.245438:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd1f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940577.245474:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944826240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940577.245547:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940577.245604:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00699fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940577.245771:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944826240 00000100:00100000:2.0:1788940577.245780:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944826240 00000100:00100000:2.0:1788940577.246514:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788940577.246527:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944826240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940577.246545:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940577.246562:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0355e6800/0x9c34acc08badd1fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd1f6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940577.246590:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0355e6800/0x9c34acc08badd1fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd1f6 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940577.246601:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0355e6800/0x9c34acc08badd1fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd1f6 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940577.246610:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6800, rc 0) 00000100:00100000:2.0:1788940577.246670:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944826240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940577.246677:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788940577.246977:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944826240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940577.247002:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd1f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd1fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940577.247013:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd1f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd1fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940577.247080:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944826368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940577.247109:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940577.248028:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00699fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940577.248199:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944826368 00000100:00100000:3.0:1788940577.248208:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944826368 00000100:00100000:3.0:1788940577.248248:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788940577.248302:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944826368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940577.248458:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944826368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940577.248466:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788940577.248638:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944826368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940577.248680:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944826496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940577.248728:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940577.248740:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00699fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940577.248790:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944826496 00000100:00100000:3.0:1788940577.248794:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944826496 00000100:00100000:3.0:1788940577.248812:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788940577.248819:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944826496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940577.248899:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944826496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940577.248906:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788940577.248973:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944826496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940577.253025:0:10453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10453:1875839944826624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940577.253118:0:10453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940577.253161:0:10453:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00699fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940577.253309:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944826624 00000100:00100000:3.0:1788940577.253317:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944826624 00000100:00100000:3.0:1788940577.253358:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788940577.253366:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:10453:x1875839944826624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940577.253499:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:10453:x1875839944826624:12345-0@lo:502:llog_process_th.0 Request processed in 132us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940577.253507:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788940577.254151:0:10453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10453:1875839944826624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940577.254184:0:10453:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940577.254199:0:10453:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940577.254201:0:10453:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788940577.254208:0:10453:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d037817800 00000020:00000080:0.0:1788940577.254211:0:10453:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788940577.254327:0:10453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10453:1875839944826752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940577.254373:0:10453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940577.254399:0:10453:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00699fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940577.258520:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944826752 00000100:00100000:3.0:1788940577.258535:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944826752 00000100:00100000:3.0:1788940577.258595:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788940577.258610:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:10453:x1875839944826752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940577.258766:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:10453:x1875839944826752:12345-0@lo:502:llog_process_th.0 Request processed in 157us (4392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940577.258774:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788940577.258896:0:10453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10453:1875839944826752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940577.258930:0:10453:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940577.258938:0:10453:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940577.258940:0:10453:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788940577.258945:0:10453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788940577.259066:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788940577.259090:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788940577.259099:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd1f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd1fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940577.259110:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd1f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd1fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940577.259119:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788940577.259122:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d035758800 from 4 10000000:01000000:3.0:1788940577.259125:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788940577.259155:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badd204 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940577.259162:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badd204 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940577.259171:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badd204 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940577.259191:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944826880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788940577.259227:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940577.259254:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00bca9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940577.259293:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944826880 00000100:00100000:3.0:1788940577.259297:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944826880 00000100:00100000:3.0:1788940577.259328:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788940577.259334:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944826880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940577.259343:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940577.259354:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd20b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd204 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940577.259374:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd20b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd204 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940577.259384:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd20b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd204 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940577.259392:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0421c0c00, rc 0) 00000100:00100000:3.0:1788940577.259431:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944826880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940577.259437:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788940577.259465:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944826880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940577.259478:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badd204 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd20b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940577.259486:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badd204 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd20b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940577.259534:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944827008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940577.259559:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940577.259571:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00bca9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940577.259581:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944827008 00000100:00100000:3.0:1788940577.259584:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944827008 00000100:00100000:3.0:1788940577.259611:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788940577.259618:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944827008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940577.259704:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944827008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940577.259710:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788940577.259738:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944827008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940577.259762:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944827136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940577.259795:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940577.259808:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03117b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788940577.259819:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944827136 00000100:00100000:3.0:1788940577.259822:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944827136 00000100:00100000:3.0:1788940577.259840:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788940577.259846:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944827136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940577.259908:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944827136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940577.259915:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788940577.259951:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944827136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940577.268976:0:10455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10455:1875839944827264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940577.269087:0:10455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940577.269131:0:10455:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00699f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788940577.269182:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944827264 00000100:00100000:3.0:1788940577.269190:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944827264 00000100:00100000:3.0:1788940577.269241:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788940577.269252:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:10455:x1875839944827264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940577.269541:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:10455:x1875839944827264:12345-0@lo:502:llog_process_th.0 Request processed in 290us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940577.269550:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788940577.273541:0:10455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10455:1875839944827264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940577.273598:0:10455:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940577.273612:0:10455:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940577.273615:0:10455:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788940577.273622:0:10455:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d035758800 00000020:00000080:0.0:1788940577.273625:0:10455:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788940577.273730:0:10455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10455:1875839944827392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940577.273814:0:10455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940577.273849:0:10455:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00300e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788940577.274694:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944827392 00000100:00100000:1.0:1788940577.274704:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944827392 00000100:00100000:1.0:1788940577.274761:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788940577.274771:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:10455:x1875839944827392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940577.274915:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:10455:x1875839944827392:12345-0@lo:502:llog_process_th.0 Request processed in 145us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940577.274924:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788940577.275345:0:10455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10455:1875839944827392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940577.275376:0:10455:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940577.275384:0:10455:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940577.275390:0:10455:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788940577.275395:0:10455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788940577.278501:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788940577.278547:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788940577.278560:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badd204 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd20b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940577.278573:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badd204 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd20b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940577.278585:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788940577.278588:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d034739000 from 4 10000000:01000000:3.0:1788940577.278591:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788940577.278626:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badd212 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940577.278635:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badd212 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940577.278646:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badd212 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940577.278671:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944827520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788940577.278743:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940577.278821:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03117b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940577.285476:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944827520 00000100:00100000:0.0:1788940577.285491:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944827520 00000100:00100000:0.0:1788940577.285553:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788940577.285563:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944827520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940577.285582:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940577.285604:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584d200/0x9c34acc08badd219 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd212 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940577.285641:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584d200/0x9c34acc08badd219 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd212 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940577.285655:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584d200/0x9c34acc08badd219 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd212 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940577.285664:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584d200, rc 0) 00000100:00100000:0.0:1788940577.285743:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944827520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (6999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940577.285750:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788940577.285946:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944827520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940577.285967:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badd212 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd219 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940577.285976:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badd212 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd219 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940577.286050:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944827648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940577.286099:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940577.286130:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03117b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788940577.286146:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944827648 00000100:00100000:3.0:1788940577.286150:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944827648 00000100:00100000:3.0:1788940577.286174:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788940577.286180:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944827648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940577.286392:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944827648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940577.286399:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788940577.286899:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944827648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940577.286933:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944827776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940577.286984:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940577.287000:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03117b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940577.289558:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944827776 00000100:00100000:0.0:1788940577.289573:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944827776 00000100:00100000:0.0:1788940577.289638:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788940577.289649:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944827776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940577.289829:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944827776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (2844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940577.289837:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788940577.290675:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944827776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940577.295606:0:10458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10458:1875839944827904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940577.295696:0:10458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940577.295743:0:10458:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03117b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940577.299789:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944827904 00000100:00100000:0.0:1788940577.299805:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944827904 00000100:00100000:0.0:1788940577.299873:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788940577.299884:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:10458:x1875839944827904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940577.300055:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:10458:x1875839944827904:12345-0@lo:502:llog_process_th.0 Request processed in 173us (4359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940577.300063:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788940577.300721:0:10458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10458:1875839944827904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940577.300766:0:10458:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940577.300779:0:10458:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940577.300782:0:10458:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788940577.300790:0:10458:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d034739000 00000020:00000080:0.0:1788940577.300792:0:10458:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788940577.300945:0:10458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10458:1875839944828032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940577.301000:0:10458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940577.301022:0:10458:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03117b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788940577.302797:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944828032 00000100:00100000:3.0:1788940577.302814:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944828032 00000100:00100000:3.0:1788940577.304376:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788940577.304394:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:10458:x1875839944828032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940577.304564:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:10458:x1875839944828032:12345-0@lo:502:llog_process_th.0 Request processed in 177us (3564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940577.304573:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788940577.304998:0:10458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10458:1875839944828032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788940577.305037:0:10458:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940577.305046:0:10458:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940577.305049:0:10458:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788940577.305053:0:10458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788940577.307978:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788940577.308019:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940577.308031:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badd212 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd219 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940577.308052:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badd212 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd219 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940577.308065:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788940577.308068:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d004f4a000 from 4 10000000:01000000:1.0:1788940577.308071:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940577.308115:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd220 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940577.308136:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd220 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940577.308149:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd220 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940577.308177:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944828160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788940577.308243:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940577.308317:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310b3780 going to sleep for 11 seconds 00000100:00100000:2.0:1788940577.308399:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944828160 00000100:00100000:2.0:1788940577.308407:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944828160 00000100:00100000:2.0:1788940577.308456:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788940577.308466:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944828160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940577.308489:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940577.308504:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0355e6200/0x9c34acc08badd227 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd220 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940577.308528:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0355e6200/0x9c34acc08badd227 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd220 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940577.308538:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0355e6200/0x9c34acc08badd227 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd220 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940577.308546:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6200, rc 0) 00000100:00100000:2.0:1788940577.308591:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944828160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940577.308597:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788940577.309147:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944828160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940577.309165:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd220 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd227 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940577.309174:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd220 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd227 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940577.309238:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944828288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940577.309302:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940577.309324:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310b3780 going to sleep for 11 seconds 00000100:00100000:3.0:1788940577.309945:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944828288 00000100:00100000:3.0:1788940577.309954:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944828288 00000100:00100000:3.0:1788940577.309993:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788940577.310001:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944828288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940577.310134:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944828288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940577.310142:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788940577.314133:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944828288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940577.314206:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944828416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940577.314312:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940577.314351:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310b3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788940577.314600:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944828416 00000100:00100000:0.0:1788940577.314608:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944828416 00000100:00100000:0.0:1788940577.314663:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788940577.314673:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944828416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940577.314785:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944828416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940577.314793:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788940577.314931:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944828416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940577.328963:0:10460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10460:1875839944828544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940577.329067:0:10460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940577.329120:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944828544 00000100:00100000:1.0:1788940577.329127:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944828544 00000100:00100000:1.0:1788940577.329173:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788940577.329182:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:10460:x1875839944828544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940577.329331:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:10460:x1875839944828544:12345-0@lo:502:llog_process_th.0 Request processed in 149us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940577.329339:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788940577.329576:0:10460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310b3600 going to sleep for 11 seconds 00000100:00100000:1.0:1788940577.329599:0:10460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10460:1875839944828544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788940577.329628:0:10460:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940577.329637:0:10460:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940577.329640:0:10460:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788940577.329648:0:10460:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d004f4a000 00000020:00000080:1.0:1788940577.329650:0:10460:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788940577.331191:0:10460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10460:1875839944828672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940577.331285:0:10460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940577.331314:0:10460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d003c36f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940577.331949:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944828672 00000100:00100000:0.0:1788940577.331959:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944828672 00000100:00100000:0.0:1788940577.332013:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788940577.332023:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:10460:x1875839944828672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940577.332150:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:10460:x1875839944828672:12345-0@lo:502:llog_process_th.0 Request processed in 128us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940577.332165:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788940577.332368:0:10460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:10460:1875839944828672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788940577.332400:0:10460:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940577.332692:0:10460:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940577.332695:0:10460:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788940577.332701:0:10460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788940577.340191:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788940577.340239:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788940577.340250:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd220 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd227 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940577.340289:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd220 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd227 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940577.947681:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940577.947706:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944828800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788940577.947781:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940577.947890:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944828800 00000100:00100000:1.0:1788940577.947899:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944828800 00000100:00100000:1.0:1788940577.947954:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788940577.947964:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944828800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788940577.948030:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788940577.948235:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944828800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788940577.950239:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944828800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940577.950695:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1788940578.079442:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940578.459753:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944828928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940578.459842:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940578.460087:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944828928 00000100:00100000:0.0:1788940578.460096:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944828928 00000100:00100000:0.0:1788940578.460162:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788940578.460173:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944828928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788940578.460205:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940578.460278:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944828928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940578.460286:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788940578.460457:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944829056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940578.460494:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940578.460550:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944829056 00000100:00100000:2.0:1788940578.460554:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944829056 00000100:00100000:2.0:1788940578.460583:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788940578.460590:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944829056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940578.460601:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788940578.461106:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788940578.461152:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ff2300 x1875839944828928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940578.461176:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944828928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788940578.461515:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944829056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 923us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940578.461542:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788940578.462105:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08585500 x1875839944829056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940578.462142:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944829056:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788940579.099514:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940579.116721:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940579.116767:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940579.116795:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921692288 00000100:00100000:1.0:1788940579.116807:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921692288 00000100:00100000:0.0:1788940579.116810:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940579.116845:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940579.116865:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 280 00000100:00100000:0.0:1788940579.116868:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940579.116886:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2407:x1875839921692288:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940579.116913:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921692544 00000100:00100000:0.0:1788940579.116917:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921692544 00000100:00100000:0.0:1788940579.116951:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921692416 00000100:00100000:0.0:1788940579.116953:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921692416 00000100:00100000:1.0:1788940579.116961:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2407:x1875839921692288:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 87us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940579.116969:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 280 00000100:00100000:0.0:1788940579.116971:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 88 00000100:00100000:0.0:1788940579.116992:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921692544:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940579.116999:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921692800 00000100:00100000:1.0:1788940579.117002:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921692800 00000100:00100000:0.0:1788940579.117023:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921692544:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 32us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940579.117025:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921692672 00000100:00100000:1.0:1788940579.117027:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921692672 00000100:00100000:0.0:1788940579.117030:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 88 00000100:00100000:0.0:1788940579.117043:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 89 00000100:00100000:1.0:1788940579.117044:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00100000:0.0:1788940579.117049:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921692416:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940579.117050:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035df0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921692800:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940579.117085:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035df0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921692800:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 35us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940579.117092:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00080000:3.0:1788940579.117120:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940579.117125:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940579.117127:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940579.117129:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788940579.117346:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 35 00000100:00100000:2.0:1788940579.117356:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921692672:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940579.119524:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921692416:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 2462us (2666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940579.119537:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 89 00000100:00100000:2.0:1788940579.122997:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921692672:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 5628us (6111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940579.123014:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 35 00000100:00100000:1.0:1788940579.483623:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940579.486151:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944829184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940579.486941:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940579.488473:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944829184 00000100:00100000:2.0:1788940579.488489:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944829184 00000100:00100000:2.0:1788940579.488572:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788940579.488584:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944829184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940579.488641:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940579.488730:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944829184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940579.488737:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788940579.502977:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944829184:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788940580.123433:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940580.516276:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944829312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940580.516357:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940580.516419:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944829824:0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.516459:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940580.516484:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944830336:0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.516506:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940580.516526:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944830848:0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.516543:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940580.516566:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788940580.516574:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944829440:0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.516613:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940580.516635:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944829952:0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.516656:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940580.516673:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944830464:0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.516690:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940580.516703:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944830976:0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.516720:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940580.516750:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944829568:0@lo:400:kworker.0 00000100:00100000:2.0:1788940580.516876:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944829312 00000100:00100000:2.0:1788940580.516884:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944829312 00000100:00100000:2.0:1788940580.516943:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788940580.516954:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944829312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788940580.516983:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940580.517030:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944829312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940580.517037:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788940580.517190:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940580.517221:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944830080:0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.517276:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940580.517294:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944830592:0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.517314:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940580.517330:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944831104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940580.517348:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940580.517368:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788940580.517374:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944829696:0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.517407:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940580.517426:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944830208:0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.517445:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940580.517460:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944830720:0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.517479:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940580.517503:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944830336 00000100:00100000:3.0:1788940580.517507:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944830336 00000100:00100000:3.0:1788940580.517530:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944830848 00000100:00100000:3.0:1788940580.517533:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944830848 00000100:00100000:3.0:1788940580.517544:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944830464 00000100:00100000:3.0:1788940580.517546:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944830464 00000100:00100000:3.0:1788940580.517575:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944830976 00000100:00100000:3.0:1788940580.517578:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944830976 00000100:00100000:2.0:1788940580.517682:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944829824 00000100:00100000:2.0:1788940580.517687:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944829824 00000100:00100000:2.0:1788940580.517707:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944829568 00000100:00100000:2.0:1788940580.517709:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944829568 00000100:00100000:2.0:1788940580.517730:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944830080 00000100:00100000:2.0:1788940580.517732:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944830080 00000100:00100000:2.0:1788940580.517743:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944830592 00000100:00100000:2.0:1788940580.517745:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944830592 00000100:00100000:2.0:1788940580.517755:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944830208 00000100:00100000:2.0:1788940580.517757:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944830208 00000100:00100000:2.0:1788940580.517768:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944830720 00000100:00100000:2.0:1788940580.517771:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944830720 00000100:00100000:2.0:1788940580.517799:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788940580.517805:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944829824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940580.517844:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944829824:12345-0@lo:400:kworker.0 Request processed in 39us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940580.517852:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788940580.517865:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788940580.517870:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944829568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940580.517901:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944829568:12345-0@lo:400:kworker.0 Request processed in 31us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940580.517907:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788940580.517918:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788940580.517923:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944830080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940580.517947:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944830080:12345-0@lo:400:kworker.0 Request processed in 24us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940580.517953:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788940580.517963:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788940580.517968:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944830592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940580.517991:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944830592:12345-0@lo:400:kworker.0 Request processed in 23us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940580.518005:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788940580.518016:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788940580.518021:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944830208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940580.518052:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944830208:12345-0@lo:400:kworker.0 Request processed in 31us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940580.518058:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788940580.518068:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788940580.518073:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944830720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940580.518107:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944830720:12345-0@lo:400:kworker.0 Request processed in 35us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940580.518112:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788940580.518709:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788940580.518717:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944830336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.518754:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944830336:12345-0@lo:400:kworker.0 Request processed in 38us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940580.518760:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788940580.518835:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788940580.518843:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944830848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.518874:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944830848:12345-0@lo:400:kworker.0 Request processed in 32us (2330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940580.518880:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788940580.518893:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788940580.518899:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944830464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.518923:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944830464:12345-0@lo:400:kworker.0 Request processed in 25us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940580.518941:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788940580.518951:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788940580.518957:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944830976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.518983:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944830976:12345-0@lo:400:kworker.0 Request processed in 27us (2263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940580.518989:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788940580.519014:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944829440 00000100:00100000:3.0:1788940580.519021:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944829440 00010000:00080000:2.0:1788940580.519337:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f71500 x1875839944830464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940580.519354:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944830464:0@lo:400:kworker.0 00010000:00080000:2.0:1788940580.519366:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f73480 x1875839944830976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940580.519375:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944830976:0@lo:400:kworker.0 00010000:00080000:2.0:1788940580.519386:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0359fad80 x1875839944829312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940596 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940580.519400:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944829312:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940580.519411:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944829824:0@lo:400:kworker.0 00010000:00080000:2.0:1788940580.519421:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f70380 x1875839944830336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940580.519437:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944830336:0@lo:400:kworker.0 00010000:00080000:2.0:1788940580.519448:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f71180 x1875839944830848/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940580.519456:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944830848:0@lo:400:kworker.0 00000100:00080000:2.0:1788940580.519495:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940580.519500:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940580.519504:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940580.519506:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940580.519524:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944829952 00000100:00100000:2.0:1788940580.519528:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944829952 00000100:00100000:2.0:1788940580.519554:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944829696 00000100:00100000:2.0:1788940580.519557:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944829696 00000100:00100000:2.0:1788940580.519569:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788940580.519576:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944829952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940580.519633:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944829952:12345-0@lo:400:kworker.0 Request processed in 57us (2975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940580.519639:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788940580.519653:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788940580.519659:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944829696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940580.519684:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944829696:12345-0@lo:400:kworker.0 Request processed in 26us (2276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940580.519689:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788940580.519713:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944829952:0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.521420:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788940580.521440:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944829440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.521518:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944829440:12345-0@lo:400:kworker.0 Request processed in 86us (4903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940580.521525:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788940580.521632:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944829440:0@lo:400:kworker.0 00000100:00100000:2.0:1788940580.523317:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944831104 00000100:00100000:2.0:1788940580.523329:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944831104 00000100:00100000:2.0:1788940580.523379:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788940580.523389:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944831104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940580.523413:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940580.523482:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944831104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (6133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940580.523490:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788940580.533455:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944829696:0@lo:400:kworker.0 00010000:00080000:3.0:1788940580.533478:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f73800 x1875839944830208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940580.533489:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944830208:0@lo:400:kworker.0 00010000:00080000:3.0:1788940580.533501:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f73b80 x1875839944830720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940580.533509:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944830720:0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.533520:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944829568:0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.533530:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944830080:0@lo:400:kworker.0 00000100:00100000:3.0:1788940580.533540:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944830592:0@lo:400:kworker.0 00010000:00080000:3.0:1788940580.533561:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0359d5180 x1875839944831104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940596 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940580.533580:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944831104:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788940581.155913:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940582.180080:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940583.074790:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940583.074819:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944831232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940583.074897:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940583.075202:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944831232 00000100:00100000:1.0:1788940583.075234:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944831232 00000100:00100000:1.0:1788940583.075944:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788940583.075958:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944831232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788940583.076006:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788940583.076081:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944831232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940583.076088:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788940583.084454:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944831232:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788940583.195468:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940583.580095:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944831360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940583.580169:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940583.580286:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944831360 00000100:00100000:1.0:1788940583.580296:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944831360 00000100:00100000:1.0:1788940583.580349:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788940583.580358:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944831360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940583.580387:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940583.580431:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944831360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940583.580438:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788940583.580461:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940583.580499:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f38380 x1875839944831360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940583.580518:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944831360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940583.581234:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940583.581246:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944831488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940583.581470:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940583.581518:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944831488 00000100:00100000:0.0:1788940583.581524:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944831488 00000100:00100000:0.0:1788940583.581564:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788940583.581570:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944831488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788940583.581584:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940583.581614:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944831488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940583.581621:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788940583.581638:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788940583.581682:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0359f9f80 x1875839944831488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940583.581699:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944831488:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1788940584.180020:0:10701:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788940584.220403:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940584.232173:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940584.232217:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940584.232245:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940584.232295:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921693184 00000100:00100000:0.0:1788940584.232304:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921693184 00000100:00100000:0.0:1788940584.232353:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921693056 00000100:00100000:0.0:1788940584.232355:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921693056 00000100:00100000:0.0:1788940584.232374:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 96 00000100:00100000:0.0:1788940584.232383:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921693184:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940584.232445:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921693184:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 63us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940584.232453:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 96 00000100:00100000:0.0:1788940584.232470:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 97 00000100:00100000:0.0:1788940584.232476:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2406:x1875839921693056:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940584.232513:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2406:x1875839921693056:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 37us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940584.232520:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 97 00000100:00080000:0.0:1788940584.232537:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940584.232540:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788940584.232675:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921692928 00000100:00100000:1.0:1788940584.232679:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921692928 00000100:00100000:1.0:1788940584.232713:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 282 00000100:00100000:1.0:1788940584.232719:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2406:x1875839921692928:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940584.232755:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2406:x1875839921692928:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 37us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940584.232767:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 282 00000100:00100000:0.0:1788940584.258937:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940584.259014:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921693312 00000100:00100000:3.0:1788940584.259025:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921693312 00000100:00100000:3.0:1788940584.259100:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:3.0:1788940584.259112:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2403:x1875839921693312:12345-192.168.202.25@tcp:9:kworker.0 00000020:00000080:3.0:1788940584.259150:0:8438:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd139 00000100:00080000:3.0:1788940584.259160:0:8438:0:(import.c:65:import_set_state_nolock()) ffff91cf07a19800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788940584.259219:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788940584.259403:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+2:2403:x1875839921693312:12345-192.168.202.25@tcp:9:kworker.0 Request processed in 292us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940584.259411:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00080000:0.0:1788940584.260003:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788940584.260017:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940584.264067:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940584.269338:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921693440 00000100:00100000:2.0:1788940584.269353:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921693440 00000100:00100000:2.0:1788940584.269420:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:2.0:1788940584.269431:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2403:x1875839921693440:12345-192.168.202.25@tcp:9:kworker.0 00000100:00080000:3.0:1788940584.269539:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:2.0:1788940584.269630:0:8437:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd140 00000100:00080000:2.0:1788940584.269641:0:8437:0:(import.c:65:import_set_state_nolock()) ffff91cf07a1c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788940584.269764:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788940584.269934:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+2:2403:x1875839921693440:12345-192.168.202.25@tcp:9:kworker.0 Request processed in 503us (5875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940584.269942:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 19 00010000:00010000:3.0:1788940584.270024:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940584.603622:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940584.603667:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944831616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788940584.603754:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940584.603833:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944831616 00000100:00100000:0.0:1788940584.603841:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944831616 00000100:00100000:0.0:1788940584.603886:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788940584.603896:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944831616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788940584.603931:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788940584.603976:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944831616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940584.603984:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788940584.604028:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944831616:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788940585.244061:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940585.627596:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940585.627632:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944831744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940585.627738:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940585.627818:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944831744 00000100:00100000:0.0:1788940585.627829:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944831744 00000100:00100000:0.0:1788940585.627903:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788940585.627915:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944831744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940585.627960:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940585.628014:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944831744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940585.628022:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788940585.628051:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788940585.628089:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a50000 x1875839944831744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940585.628111:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944831744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940585.628684:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944832000:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.628731:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940585.628754:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944832512:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.628774:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940585.628790:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944833024:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.628808:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940585.628835:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788940585.628841:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944831872:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.628872:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940585.628903:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944832384:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.628930:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940585.628948:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944832896:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.628986:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940585.629016:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944831872 00000100:00100000:3.0:1788940585.629022:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944831872 00000100:00100000:3.0:1788940585.629062:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788940585.629070:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944831872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.629108:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944831872:12345-0@lo:400:kworker.0 Request processed in 38us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940585.629116:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788940585.629146:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944832384 00000100:00100000:3.0:1788940585.629149:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944832384 00000100:00100000:3.0:1788940585.629170:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788940585.629176:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944832384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.629409:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944832384:12345-0@lo:400:kworker.0 Request processed in 233us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940585.629416:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788940585.629434:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944832896 00000100:00100000:3.0:1788940585.629438:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944832896 00000100:00100000:3.0:1788940585.629474:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788940585.629481:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944832896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.629510:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944832896:12345-0@lo:400:kworker.0 Request processed in 30us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940585.629515:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788940585.629541:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944832256:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.629578:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940585.629598:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944832768:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.629617:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940585.629632:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944833280:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.629664:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940585.629735:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944832768 00000100:00100000:2.0:1788940585.629739:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944832768 00000100:00100000:2.0:1788940585.629915:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944833280 00000100:00100000:2.0:1788940585.629919:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944833280 00000100:00100000:2.0:1788940585.629945:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788940585.629952:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944832768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940585.630146:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944832000 00000100:00100000:0.0:1788940585.630151:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944832000 00000100:00100000:0.0:1788940585.630183:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944832512 00000100:00100000:0.0:1788940585.630196:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944832512 00000100:00100000:0.0:1788940585.630212:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944833024 00000100:00100000:0.0:1788940585.630215:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944833024 00000100:00100000:0.0:1788940585.630227:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944832256 00000100:00100000:0.0:1788940585.630230:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944832256 00000100:00100000:0.0:1788940585.630242:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788940585.630248:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944832000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940585.632043:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944832768:12345-0@lo:400:kworker.0 Request processed in 2079us (2411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940585.632074:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788940585.632115:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788940585.632128:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944833280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940585.632182:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944833280:12345-0@lo:400:kworker.0 Request processed in 61us (2518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940585.632199:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788940585.632782:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07844000 x1875839944833280/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940585.632801:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944833280:0@lo:400:kworker.0 00010000:00080000:3.0:1788940585.632845:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07847800 x1875839944832768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940585.632854:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944832768:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.632863:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788940585.632875:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944832128:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.632928:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940585.633046:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944832128 00000100:00100000:2.0:1788940585.633056:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944832128 00000100:00100000:2.0:1788940585.633117:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788940585.633126:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944832128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940585.633173:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944832128:12345-0@lo:400:kworker.0 Request processed in 49us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940585.633181:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788940585.633333:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788940585.633347:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944832512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940585.633390:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944832512:12345-0@lo:400:kworker.0 Request processed in 48us (4614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940585.633397:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788940585.633415:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788940585.633422:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944833024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940585.633452:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944833024:12345-0@lo:400:kworker.0 Request processed in 30us (4643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940585.633458:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788940585.633469:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788940585.633476:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944832256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940585.633506:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944832256:12345-0@lo:400:kworker.0 Request processed in 31us (3928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940585.633511:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788940585.633573:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944832640:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.633610:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940585.633639:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944833152:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.633661:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940585.633700:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944832256:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.633718:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944832128:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.633744:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944832640 00000100:00100000:3.0:1788940585.633748:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944832640 00000100:00100000:3.0:1788940585.633778:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944833152 00000100:00100000:3.0:1788940585.633795:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944833152 00000100:00100000:3.0:1788940585.633816:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788940585.633821:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944832640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.633863:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944832640:12345-0@lo:400:kworker.0 Request processed in 41us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940585.633869:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788940585.633882:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788940585.633888:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944833152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.633917:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944833152:12345-0@lo:400:kworker.0 Request processed in 30us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940585.633923:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788940585.633952:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944831872:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.634133:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944832384:0@lo:400:kworker.0 00010000:00080000:3.0:1788940585.634155:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07846a00 x1875839944832896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940585.634166:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944832896:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.634179:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944832512:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.634202:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944833024:0@lo:400:kworker.0 00000100:00100000:3.0:1788940585.634220:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940585.634231:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944833408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940585.638427:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788940585.638593:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07844380 x1875839944832640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940585.638613:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944832640:0@lo:400:kworker.0 00010000:00080000:3.0:1788940585.638638:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07844e00 x1875839944833152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940585.638648:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944833152:0@lo:400:kworker.0 00000100:00100000:2.0:1788940585.638735:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944833408 00000100:00100000:2.0:1788940585.638745:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944833408 00000100:00100000:2.0:1788940585.638812:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788940585.638824:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944833408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788940585.638859:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940585.638940:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944833408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940585.638948:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788940585.639112:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944832000:12345-0@lo:400:kworker.0 Request processed in 8861us (10378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940585.639123:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1788940585.639167:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788940585.639174:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940585.639178:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940585.639182:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788940585.639317:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a50000 x1875839944833408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940585.639336:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944833408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940585.639350:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944832000:0@lo:400:kworker.0 00010000:00010000:0.0:1788940586.274608:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940587.296008:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940588.198400:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940588.198449:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944833536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940588.198559:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940588.198878:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944833536 00000100:00100000:2.0:1788940588.198894:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944833536 00000100:00100000:2.0:1788940588.198968:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788940588.198978:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944833536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940588.199016:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788940588.199132:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944833536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 155us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940588.199140:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788940588.199203:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944833536:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788940588.320917:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940588.701425:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944833664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940588.701500:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940588.701584:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944833664 00000100:00100000:0.0:1788940588.701592:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944833664 00000100:00100000:0.0:1788940588.701671:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788940588.701682:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944833664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788940588.701713:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940588.701756:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944833664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940588.701779:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788940588.701803:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788940588.701834:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a50380 x1875839944833664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940588.701854:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944833664:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788940588.702932:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940588.702947:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944833792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940588.702996:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940588.703056:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944833792 00000100:00100000:2.0:1788940588.703062:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944833792 00000100:00100000:2.0:1788940588.703111:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788940588.703119:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944833792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940588.703140:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940588.703189:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944833792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940588.703195:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788940588.703215:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788940588.703238:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f72680 x1875839944833792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940588.703254:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944833792:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788940589.349889:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940589.355281:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940589.355326:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940589.355354:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940589.355383:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921693824 00000100:00100000:1.0:1788940589.355393:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921693824 00000100:00100000:1.0:1788940589.355450:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921693696 00000100:00100000:1.0:1788940589.355461:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921693696 00000100:00100000:1.0:1788940589.355495:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 104 00000100:00100000:1.0:1788940589.355505:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921693824:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940589.355576:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921693824:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 73us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940589.355584:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 104 00000100:00100000:1.0:1788940589.355606:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 105 00000100:00100000:1.0:1788940589.355613:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921693696:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940589.355638:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921693696:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 25us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940589.355643:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 105 00000100:00080000:2.0:1788940589.355941:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940589.355946:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788940589.356203:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921693568 00000100:00100000:3.0:1788940589.356209:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921693568 00000100:00100000:3.0:1788940589.356254:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 284 00000100:00100000:3.0:1788940589.356283:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2407:x1875839921693568:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940589.356333:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2407:x1875839921693568:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 53us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940589.356340:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 284 00000100:00100000:2.0:1788940589.726770:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944833920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788940589.726845:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940589.727012:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944833920 00000100:00100000:1.0:1788940589.727020:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944833920 00000100:00100000:1.0:1788940589.727076:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788940589.727085:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944833920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788940589.727118:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788940589.727186:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944833920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940589.727193:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788940589.727298:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944833920:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1788940589.734205:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 82f3b232-46da-4a78-8599-45df2ddbced0 00000020:00000080:2.0:1788940589.734216:0:9517:0:(genops.c:893:class_export_put()) final put ffff91cf07a1b000/82f3b232-46da-4a78-8599-45df2ddbced0 00000020:00000080:3.0:1788940589.734310:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf07a1b000/82f3b232-46da-4a78-8599-45df2ddbced0 for lustre-OST0001 00000020:00000080:3.0:1788940589.734356:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf07a1c800 for lustre-OST0001 00000001:00100000:1.0:1788940589.735042:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 82f3b232-46da-4a78-8599-45df2ddbced0 00000020:00000080:1.0:1788940589.735048:0:8432:0:(genops.c:893:class_export_put()) final put ffff91cf07a1a800/82f3b232-46da-4a78-8599-45df2ddbced0 00000020:00000080:2.0:1788940589.735330:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf07a1a800/82f3b232-46da-4a78-8599-45df2ddbced0 for lustre-OST0000 00000020:00000080:2.0:1788940589.735383:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf07a19800 for lustre-OST0000 00010000:00010000:3.0:1788940590.366082:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788940590.411638:0:10945:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing yml_node 00000100:00100000:0.0:1788940590.751863:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944834048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940590.751941:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940590.755122:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944834048 00000100:00100000:2.0:1788940590.755148:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944834048 00000100:00100000:2.0:1788940590.755222:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788940590.755236:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944834048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940590.755295:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940590.755378:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944834048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (3435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940590.755385:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788940590.755416:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788940590.755771:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a50380 x1875839944834048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940590.755790:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944834048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940590.756293:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940590.756307:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944834176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940590.756353:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940590.756399:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944834176 00000100:00100000:0.0:1788940590.756404:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944834176 00000100:00100000:0.0:1788940590.756444:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788940590.756451:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944834176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788940590.756466:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940590.756787:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944834176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 335us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940590.756795:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788940590.756833:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788940590.756858:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a50380 x1875839944834176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940590.756872:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944834176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940590.764611:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944834304:0@lo:400:kworker.0 00000100:00100000:3.0:1788940590.764686:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940590.764785:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944834816:0@lo:400:kworker.0 00000100:00100000:3.0:1788940590.764814:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940590.764832:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944835328:0@lo:400:kworker.0 00000100:00100000:3.0:1788940590.764865:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940590.764889:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788940590.764895:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944834688:0@lo:400:kworker.0 00000100:00100000:3.0:1788940590.764916:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940590.764930:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944835200:0@lo:400:kworker.0 00000100:00100000:3.0:1788940590.764946:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940590.764975:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944834304 00000100:00100000:3.0:1788940590.764982:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944834304 00000100:00100000:3.0:1788940590.765020:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788940590.765029:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944834304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940590.765075:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944834304:12345-0@lo:400:kworker.0 Request processed in 47us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940590.765083:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788940590.765115:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944835328 00000100:00100000:3.0:1788940590.765119:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944835328 00000100:00100000:3.0:1788940590.765159:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944835200 00000100:00100000:3.0:1788940590.765162:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944835200 00000100:00100000:3.0:1788940590.765182:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788940590.765188:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944835328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940590.765220:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944835328:12345-0@lo:400:kworker.0 Request processed in 32us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940590.765226:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788940590.765237:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788940590.765243:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944835200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940590.765357:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944834432:0@lo:400:kworker.0 00000100:00100000:0.0:1788940590.765387:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940590.765407:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944834944:0@lo:400:kworker.0 00000100:00100000:0.0:1788940590.765427:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940590.765443:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944835456:0@lo:400:kworker.0 00000100:00100000:0.0:1788940590.765463:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940590.765483:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788940590.765489:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944834560:0@lo:400:kworker.0 00000100:00100000:0.0:1788940590.766380:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940590.766406:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944835072:0@lo:400:kworker.0 00000100:00100000:0.0:1788940590.766445:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940590.766471:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944835584:0@lo:400:kworker.0 00000100:00100000:0.0:1788940590.766494:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940590.766619:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944835200:12345-0@lo:400:kworker.0 Request processed in 1375us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940590.766637:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788940590.766696:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a2ea00 x1875839944835200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940590.768952:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944834816 00000100:00100000:0.0:1788940590.768966:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944834816 00000100:00100000:0.0:1788940590.769018:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944834560 00000100:00100000:0.0:1788940590.769021:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944834560 00000100:00100000:0.0:1788940590.769039:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788940590.769047:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944834816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940590.769116:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944834816:12345-0@lo:400:kworker.0 Request processed in 70us (4301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940590.769152:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788940590.769170:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788940590.769179:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944834560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940590.769215:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944834560:12345-0@lo:400:kworker.0 Request processed in 39us (2837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940590.769220:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788940590.769237:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944834688 00000100:00100000:0.0:1788940590.769241:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944834688 00000100:00100000:0.0:1788940590.769271:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944834432 00000100:00100000:0.0:1788940590.769274:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944834432 00000100:00100000:0.0:1788940590.769285:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944834944 00000100:00100000:0.0:1788940590.769287:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944834944 00000100:00100000:0.0:1788940590.769300:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944835456 00000100:00100000:0.0:1788940590.769303:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944835456 00000100:00100000:0.0:1788940590.769313:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944835072 00000100:00100000:0.0:1788940590.769315:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944835072 00000100:00100000:0.0:1788940590.769325:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944835584 00000100:00100000:0.0:1788940590.769327:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944835584 00000100:00100000:0.0:1788940590.769342:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788940590.769348:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944834688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940590.769379:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944834688:12345-0@lo:400:kworker.0 Request processed in 31us (4462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940590.769384:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788940590.769396:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788940590.769401:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944834432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940590.769426:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944834432:12345-0@lo:400:kworker.0 Request processed in 25us (4039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940590.769431:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788940590.769449:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788940590.769455:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944834944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940590.769481:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944834944:12345-0@lo:400:kworker.0 Request processed in 27us (4053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940590.769486:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788940590.769557:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944835200:0@lo:400:kworker.0 00000100:00100000:3.0:1788940590.769578:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944834304:0@lo:400:kworker.0 00000100:00100000:3.0:1788940590.769590:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944834816:0@lo:400:kworker.0 00010000:00080000:3.0:1788940590.769603:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a2fb80 x1875839944835328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940590.769611:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944835328:0@lo:400:kworker.0 00000100:00100000:3.0:1788940590.769638:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944834688:0@lo:400:kworker.0 00000100:00100000:2.0:1788940590.769923:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788940590.769935:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944835456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940590.769974:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944835456:12345-0@lo:400:kworker.0 Request processed in 44us (4509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940590.769979:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788940590.769991:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788940590.769997:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944835072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940590.770025:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944835072:12345-0@lo:400:kworker.0 Request processed in 28us (3580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940590.770030:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788940590.770041:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788940590.770046:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944835584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940590.770072:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944835584:12345-0@lo:400:kworker.0 Request processed in 27us (3578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940590.770077:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1788940590.770672:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788940590.770678:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940590.770681:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940590.770790:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944834560:0@lo:400:kworker.0 00010000:00080000:0.0:1788940590.770804:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a2e680 x1875839944835072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940590.770813:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944835072:0@lo:400:kworker.0 00010000:00080000:0.0:1788940590.770825:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a2ce00 x1875839944835584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940590.770833:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944835584:0@lo:400:kworker.0 00000100:00100000:0.0:1788940590.770844:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944834432:0@lo:400:kworker.0 00000100:00100000:0.0:1788940590.770855:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944834944:0@lo:400:kworker.0 00000100:00100000:0.0:1788940590.770865:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944835456:0@lo:400:kworker.0 00010000:00010000:0.0:1788940591.390741:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940592.411849:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940593.308034:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944835712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940593.308103:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940593.308847:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944835712 00000100:00100000:0.0:1788940593.308855:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944835712 00000100:00100000:0.0:1788940593.308896:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788940593.308903:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944835712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788940593.308942:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788940593.308980:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944835712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940593.308985:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788940593.314363:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944835712:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788940593.435926:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940593.819480:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940593.819503:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944835840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940593.819572:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940593.820062:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944835840 00000100:00100000:2.0:1788940593.820082:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944835840 00000100:00100000:2.0:1788940593.820161:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788940593.820171:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944835840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940593.820200:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940593.820277:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944835840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940593.820284:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788940593.822947:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940593.823429:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940593.823450:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944835968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940593.823510:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940593.823560:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944835968 00000100:00100000:1.0:1788940593.823566:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944835968 00000100:00100000:1.0:1788940593.823625:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788940593.823633:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944835968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788940593.823653:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940593.823692:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944835968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940593.823698:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788940593.823718:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940593.823743:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f38e00 x1875839944835968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940593.823761:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944835968:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788940593.824380:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f71180 x1875839944835840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940593.824396:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944835840:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788940594.467209:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940594.477591:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940594.478416:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940594.478494:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921694080 00000100:00100000:3.0:1788940594.478506:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921694080 00000100:00100000:3.0:1788940594.478579:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 112 00000100:00100000:3.0:1788940594.478590:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921694080:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940594.478689:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921694080:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 101us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940594.478697:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 112 00000100:00100000:3.0:1788940594.479092:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940594.479133:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921694208 00000100:00100000:3.0:1788940594.479137:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921694208 00000100:00100000:3.0:1788940594.479168:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 113 00000100:00100000:3.0:1788940594.479174:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921694208:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940594.479214:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921694208:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 31us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940594.479221:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 113 00000100:00080000:1.0:1788940594.479348:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940594.479353:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940594.481681:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921693952 00000100:00100000:2.0:1788940594.481696:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921693952 00000100:00100000:3.0:1788940594.482362:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 286 00000100:00100000:3.0:1788940594.482374:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2406:x1875839921693952:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940594.482451:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2406:x1875839921693952:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 79us (4871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940594.482459:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 286 00000100:00100000:0.0:1788940594.843438:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940594.843460:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944836096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788940594.843532:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940594.845228:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944836096 00000100:00100000:0.0:1788940594.845242:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944836096 00000100:00100000:0.0:1788940594.847015:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788940594.847031:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944836096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788940594.847074:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788940594.847231:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944836096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 204us (3698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940594.847238:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788940594.854483:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944836096:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1788940595.226929:0:11129:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:3.0:1788940595.485647:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940595.868188:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944836224:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.868279:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940595.868331:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944836736:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.868358:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940595.868376:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944837248:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.868398:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940595.868413:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf084dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944837760:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.868433:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940595.868467:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788940595.868473:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944836352:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.868497:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940595.868514:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944836864:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.868533:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940595.868550:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944837376:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.868570:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940595.868599:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944836480:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.868632:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940595.870584:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944836992:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.870660:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940595.870699:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944837504:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.870725:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940595.870751:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788940595.870757:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944836608:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.870777:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940595.870789:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944837120:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.870808:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940595.870840:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf084df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944837632:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.870860:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940595.871049:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944836224 00000100:00100000:2.0:1788940595.871057:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944836224 00000100:00100000:2.0:1788940595.871124:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788940595.871136:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944836224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.871191:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944836224:12345-0@lo:400:kworker.0 Request processed in 58us (2912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940595.871198:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788940595.871230:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944836736 00000100:00100000:2.0:1788940595.871235:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944836736 00000100:00100000:2.0:1788940595.871275:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944836480 00000100:00100000:2.0:1788940595.871279:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944836480 00000100:00100000:2.0:1788940595.871295:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788940595.871302:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944836736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.871335:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944836736:12345-0@lo:400:kworker.0 Request processed in 34us (2976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940595.871354:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788940595.871367:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788940595.871373:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944836480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.871405:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944836480:12345-0@lo:400:kworker.0 Request processed in 32us (2772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940595.871411:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788940595.871428:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944837248 00000100:00100000:2.0:1788940595.871431:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944837248 00000100:00100000:2.0:1788940595.871457:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944837760 00000100:00100000:2.0:1788940595.871460:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944837760 00000100:00100000:2.0:1788940595.871472:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944837120 00000100:00100000:2.0:1788940595.871474:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944837120 00000100:00100000:2.0:1788940595.871483:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944837632 00000100:00100000:2.0:1788940595.871485:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944837632 00000100:00100000:2.0:1788940595.871497:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788940595.871503:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944837248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.871532:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944837248:12345-0@lo:400:kworker.0 Request processed in 29us (3133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940595.871538:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788940595.871549:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788940595.871554:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944837760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.871581:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944837760:12345-0@lo:400:kworker.0 Request processed in 27us (3147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940595.871587:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788940595.871597:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788940595.871603:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944837120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.871642:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944837120:12345-0@lo:400:kworker.0 Request processed in 39us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940595.871648:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788940595.871660:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788940595.871665:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944837632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.871691:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944837632:12345-0@lo:400:kworker.0 Request processed in 27us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940595.871696:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788940595.871716:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944836352 00000100:00100000:2.0:1788940595.871720:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944836352 00000100:00100000:2.0:1788940595.871737:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944836864 00000100:00100000:2.0:1788940595.871740:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944836864 00000100:00100000:2.0:1788940595.871750:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944837376 00000100:00100000:2.0:1788940595.871753:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944837376 00000100:00100000:2.0:1788940595.871763:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944836992 00000100:00100000:2.0:1788940595.871766:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944836992 00000100:00100000:2.0:1788940595.871775:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944837504 00000100:00100000:2.0:1788940595.871777:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944837504 00000100:00100000:2.0:1788940595.871786:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944836608 00000100:00100000:2.0:1788940595.871788:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944836608 00000100:00100000:2.0:1788940595.871799:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788940595.871805:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944836352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.871834:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944836352:12345-0@lo:400:kworker.0 Request processed in 29us (3336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940595.871840:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788940595.871852:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788940595.871858:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944836864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.871884:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944836864:12345-0@lo:400:kworker.0 Request processed in 27us (3350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940595.871895:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788940595.871907:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788940595.871913:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944837376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.871940:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944837376:12345-0@lo:400:kworker.0 Request processed in 29us (3370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940595.871946:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788940595.871956:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788940595.871962:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944836992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.871985:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944836992:12345-0@lo:400:kworker.0 Request processed in 24us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940595.871990:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788940595.872000:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788940595.872006:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944837504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.872033:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944837504:12345-0@lo:400:kworker.0 Request processed in 28us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940595.872039:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788940595.872049:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788940595.872054:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944836608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.872078:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944836608:12345-0@lo:400:kworker.0 Request processed in 24us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940595.872084:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788940595.872129:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944837888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940595.872161:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940595.872215:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944836352:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.872234:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944836864:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.872244:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944837376:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.872252:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944836224:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.872285:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944836736:0@lo:400:kworker.0 00010000:00080000:2.0:1788940595.872298:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f73b80 x1875839944837248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940595.872309:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944837248:0@lo:400:kworker.0 00010000:00080000:2.0:1788940595.872318:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf084dc700 x1875839944837760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940595.872325:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf084dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944837760:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.872381:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944836608:0@lo:400:kworker.0 00010000:00080000:2.0:1788940595.872390:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f72300 x1875839944837120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940595.872398:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944837120:0@lo:400:kworker.0 00010000:00080000:2.0:1788940595.872406:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf084df100 x1875839944837632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940595.872413:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf084df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944837632:0@lo:400:kworker.0 00000100:00100000:2.0:1788940595.872423:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944836480:0@lo:400:kworker.0 00010000:00080000:2.0:1788940595.872432:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f72a00 x1875839944836992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940595.872450:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944836992:0@lo:400:kworker.0 00010000:00080000:2.0:1788940595.872462:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f73100 x1875839944837504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940595.872470:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944837504:0@lo:400:kworker.0 00000100:00080000:2.0:1788940595.872492:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940595.872496:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940595.872498:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940595.872500:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940595.872511:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944837888 00000100:00100000:2.0:1788940595.872515:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944837888 00000100:00100000:2.0:1788940595.872540:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788940595.872545:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944837888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940595.872576:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940595.872612:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944837888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940595.872618:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788940595.872642:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06ec4380 x1875839944837888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940595.872656:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944837888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940595.873471:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944838016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940595.873503:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940595.874215:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944838016 00000100:00100000:1.0:1788940595.874223:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944838016 00000100:00100000:1.0:1788940595.874293:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788940595.874302:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944838016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788940595.874324:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940595.874366:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944838016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940595.874373:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788940595.874498:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f5dc00 x1875839944838016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940595.874514:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944838016:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788940596.510994:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940597.531860:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788940598.286025:0:11226:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00000100:00100000:3.0:1788940598.427696:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940598.427729:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944838144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940598.427841:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940598.428170:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944838144 00000100:00100000:1.0:1788940598.428182:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944838144 00000100:00100000:1.0:1788940598.428281:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788940598.428294:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944838144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788940598.428374:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788940598.428444:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944838144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 152us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940598.428452:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788940598.428511:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944838144:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788940598.559194:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940598.947224:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944838400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940598.947524:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940598.947610:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940598.947617:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf084dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944838272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940598.947831:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944838400 00000100:00100000:1.0:1788940598.947844:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944838400 00000100:00100000:1.0:1788940598.947920:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788940598.947932:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944838400:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940598.947946:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940598.947980:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944838272 00000100:00100000:2.0:1788940598.947983:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944838272 00002000:00000024:1.0:1788940598.947986:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940598.948005:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788940598.948010:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944838272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788940598.948022:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940598.948040:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944838400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940598.948046:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944838272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940598.948048:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788940598.948052:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788940598.948087:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940598.948128:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf084dc700 x1875839944838272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940598.948149:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf084dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944838272:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788940598.948161:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f5dc00 x1875839944838400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940598.948172:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944838400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940599.595198:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940599.595244:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940599.595323:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940599.595360:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921694336 00000100:00100000:3.0:1788940599.595374:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921694336 00000100:00100000:3.0:1788940599.595455:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 288 00000100:00100000:3.0:1788940599.595467:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2407:x1875839921694336:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940599.595563:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2407:x1875839921694336:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 98us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940599.595571:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 288 00000100:00100000:3.0:1788940599.595611:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921694592 00000100:00100000:3.0:1788940599.595614:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921694592 00000100:00100000:3.0:1788940599.595664:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921694464 00000100:00100000:3.0:1788940599.595667:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921694464 00000100:00100000:3.0:1788940599.595685:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 120 00000100:00100000:3.0:1788940599.595691:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921694592:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940599.595721:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921694592:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 31us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940599.595728:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 120 00000100:00100000:3.0:1788940599.595738:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 121 00000100:00100000:3.0:1788940599.595756:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921694464:12345-192.168.202.25@tcp:400:kworker.0 00010000:00010000:0.0:1788940599.600932:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940599.601244:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921694464:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 5476us (5906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940599.605419:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 121 00000100:00080000:3.0:1788940599.605513:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940599.605521:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788940599.967914:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944838528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940599.968090:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940599.968284:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944838528 00000100:00100000:2.0:1788940599.968611:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944838528 00000100:00100000:2.0:1788940599.968680:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788940599.968693:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944838528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940599.968740:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940599.968817:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944838528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940599.968826:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788940599.968892:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944838528:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788940600.603548:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940600.987702:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944838912:0@lo:400:kworker.0 00000100:00100000:1.0:1788940600.987811:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940600.987861:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf084de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944838656:0@lo:400:kworker.0 00000100:00100000:0.0:1788940600.987915:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940600.987946:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944839040:0@lo:400:kworker.0 00000100:00100000:3.0:1788940600.987982:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940600.987997:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944839168:0@lo:400:kworker.0 00000100:00100000:3.0:1788940600.988005:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944839552:0@lo:400:kworker.0 00000100:00100000:3.0:1788940600.988027:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940600.988027:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf084dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944838784:0@lo:400:kworker.0 00000100:00100000:3.0:1788940600.988056:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944840064:0@lo:400:kworker.0 00000100:00100000:0.0:1788940600.988072:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940600.988075:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940600.988093:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944839296:0@lo:400:kworker.0 00000100:00100000:0.0:1788940600.988113:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940600.988130:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944839808:0@lo:400:kworker.0 00000100:00100000:3.0:1788940600.988135:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944838656 00000100:00100000:3.0:1788940600.988144:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944838656 00000100:00100000:0.0:1788940600.988148:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940600.988164:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944840320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940600.988184:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940600.988202:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788940600.988202:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940600.988206:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944840448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940600.988211:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944838656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940600.988226:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940600.988252:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944839040 00000100:00100000:0.0:1788940600.988276:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944839040 00000100:00100000:3.0:1788940600.988288:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944838656:12345-0@lo:400:kworker.0 Request processed in 77us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940600.988295:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788940600.988317:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944838784 00000100:00100000:0.0:1788940600.988321:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944838784 00000100:00100000:3.0:1788940600.988329:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944839296 00000100:00100000:3.0:1788940600.988331:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944839296 00000100:00100000:0.0:1788940600.988334:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944839808 00000100:00100000:0.0:1788940600.988336:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944839808 00000100:00100000:1.0:1788940600.988395:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944839424:0@lo:400:kworker.0 00000100:00100000:1.0:1788940600.988417:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940600.988428:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944839936:0@lo:400:kworker.0 00000100:00100000:1.0:1788940600.988448:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940600.988474:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944840320 00000100:00100000:1.0:1788940600.988477:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944840320 00000100:00100000:3.0:1788940600.988582:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944839424 00000100:00100000:3.0:1788940600.988586:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944839424 00000100:00100000:2.0:1788940600.989413:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944838912 00000100:00100000:2.0:1788940600.989422:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944838912 00000100:00100000:2.0:1788940600.989466:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788940600.989476:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944838912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940600.989566:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944838912:12345-0@lo:400:kworker.0 Request processed in 92us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940600.989573:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788940600.989793:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944840448 00000100:00100000:1.0:1788940600.989798:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944840448 00000100:00100000:2.0:1788940600.989883:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788940600.989893:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944840320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788940600.989926:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940600.989973:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944840320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940600.989981:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788940600.989996:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788940600.990001:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944840448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940600.990011:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940600.990037:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944840448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (1810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940600.994388:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944838912:0@lo:400:kworker.0 00000100:00100000:2.0:1788940600.999410:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788940601.000207:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944839936 00000100:00100000:0.0:1788940601.000221:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944839936 00000100:00100000:0.0:1788940601.000295:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788940601.000308:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944839040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940601.000447:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944839040:12345-0@lo:400:kworker.0 Request processed in 142us (12463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940601.000455:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788940601.000472:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788940601.000479:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944838784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940601.000512:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944838784:12345-0@lo:400:kworker.0 Request processed in 34us (12439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940601.000540:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788940601.000555:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788940601.000562:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944839296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940601.000595:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944839296:12345-0@lo:400:kworker.0 Request processed in 35us (12481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940601.000601:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788940601.000614:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788940601.000620:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944839808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940601.000648:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944839808:12345-0@lo:400:kworker.0 Request processed in 28us (12498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940601.000654:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788940601.000665:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788940601.000671:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944839936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940601.001539:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788940601.001553:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944839424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940601.001622:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944839424:12345-0@lo:400:kworker.0 Request processed in 76us (13204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940601.001629:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788940601.001656:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944839552 00000100:00100000:3.0:1788940601.001663:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944839552 00000100:00100000:3.0:1788940601.001706:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944840064 00000100:00100000:3.0:1788940601.001710:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944840064 00000100:00100000:3.0:1788940601.001731:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788940601.001737:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944839552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940601.001780:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944839552:12345-0@lo:400:kworker.0 Request processed in 44us (13752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940601.001787:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788940601.001797:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788940601.001802:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944840064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940601.001828:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944840064:12345-0@lo:400:kworker.0 Request processed in 27us (13752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940601.001834:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788940601.001879:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940601.001884:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788940601.001887:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940601.001890:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940601.001916:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940601.001958:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944839680:0@lo:400:kworker.0 00000100:00100000:3.0:1788940601.001995:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940601.002014:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944840192:0@lo:400:kworker.0 00000100:00100000:3.0:1788940601.002034:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940601.002105:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf084de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944838656:0@lo:400:kworker.0 00000100:00100000:3.0:1788940601.002135:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944839680 00000100:00100000:3.0:1788940601.002139:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944839680 00000100:00100000:3.0:1788940601.002163:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944840192 00000100:00100000:3.0:1788940601.002165:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944840192 00000100:00100000:3.0:1788940601.002178:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788940601.002184:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944839680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940601.002215:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944839680:12345-0@lo:400:kworker.0 Request processed in 31us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940601.002231:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788940601.002241:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788940601.002247:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944840192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940601.002294:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944840192:12345-0@lo:400:kworker.0 Request processed in 47us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940601.002300:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788940601.002315:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788940601.002335:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f71180 x1875839944839680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940601.002349:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944839680:0@lo:400:kworker.0 00010000:00080000:3.0:1788940601.002358:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f70e00 x1875839944840192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940601.002367:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944840192:0@lo:400:kworker.0 00010000:00080000:3.0:1788940601.002423:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06ec4e00 x1875839944840448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940616 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940601.002439:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944840448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940601.002452:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf084dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944838784:0@lo:400:kworker.0 00000100:00100000:3.0:1788940601.002464:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944839296:0@lo:400:kworker.0 00000100:00100000:3.0:1788940601.002476:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944839808:0@lo:400:kworker.0 00010000:00080000:3.0:1788940601.002489:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf079e9c00 x1875839944840320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940616 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940601.002500:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944840320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940601.002660:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944839040:0@lo:400:kworker.0 00010000:00080000:2.0:1788940601.002674:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f73b80 x1875839944839552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940601.002683:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944839552:0@lo:400:kworker.0 00010000:00080000:2.0:1788940601.002692:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f71880 x1875839944840064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940601.002700:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944840064:0@lo:400:kworker.0 00000100:00100000:1.0:1788940601.003092:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944839168 00000100:00100000:1.0:1788940601.003099:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944839168 00000100:00100000:1.0:1788940601.003132:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788940601.003138:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944839168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940601.003196:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944839168:12345-0@lo:400:kworker.0 Request processed in 57us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940601.003202:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1788940601.003234:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f71500 x1875839944839424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940601.003245:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944839424:0@lo:400:kworker.0 00000100:00100000:3.0:1788940601.005523:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944839168:0@lo:400:kworker.0 00000100:00100000:0.0:1788940601.006291:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944839936:12345-0@lo:400:kworker.0 Request processed in 5616us (17839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940601.006305:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:1.0:1788940601.006306:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f73800 x1875839944839936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940601.006319:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944839936:0@lo:400:kworker.0 00010000:00010000:2.0:1788940601.627399:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788940601.674831:0:11324:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:0.0:1788940602.652832:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940603.560443:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940603.560467:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944840576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940603.560548:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940603.560620:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944840576 00000100:00100000:3.0:1788940603.560629:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944840576 00000100:00100000:3.0:1788940603.560682:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788940603.560692:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944840576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788940603.560728:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788940603.560778:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944840576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940603.560786:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788940603.560834:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944840576:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788940603.679580:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788940603.772733:0:11372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 9 03:56:42 EDT 2026 00000100:00100000:1.0:1788940604.065067:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944840704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940604.065170:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940604.065297:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944840704 00000100:00100000:1.0:1788940604.065308:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944840704 00000100:00100000:1.0:1788940604.065395:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788940604.065407:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944840704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940604.065447:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940604.065510:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944840704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940604.065518:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1788940604.065546:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940604.065596:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03588f480 x1875839944840704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940604.065621:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944840704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940604.076778:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944840832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788940604.076888:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940604.076960:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944840832 00000100:00100000:2.0:1788940604.076971:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944840832 00000100:00100000:2.0:1788940604.077052:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788940604.077063:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944840832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788940604.077093:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940604.077147:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944840832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940604.077155:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1788940604.077205:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f71880 x1875839944840832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940604.077228:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944840832:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788940604.098712:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788940604.699537:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940604.709252:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940604.709382:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940604.709544:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921694720 00000100:00100000:0.0:1788940604.709559:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921694720 00000100:00100000:0.0:1788940604.709655:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 290 00000100:00100000:0.0:1788940604.709668:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2407:x1875839921694720:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940604.709773:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2407:x1875839921694720:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 108us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940604.709803:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 290 00000100:00100000:3.0:1788940604.709955:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940604.710328:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921694976 00000100:00100000:2.0:1788940604.710329:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921694848 00000100:00100000:0.0:1788940604.710336:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921694976 00000100:00100000:2.0:1788940604.710348:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921694848 00000100:00100000:0.0:1788940604.710423:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 128 00000100:00100000:0.0:1788940604.710436:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921694976:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940604.710456:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 129 00000100:00100000:2.0:1788940604.710474:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921694848:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940604.710504:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921694976:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 69us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940604.710513:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 128 00000100:00100000:2.0:1788940604.710564:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921694848:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 95us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940604.710572:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 129 00000100:00080000:3.0:1788940604.710817:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940604.710824:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788940605.091186:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940605.091221:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944840960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788940605.091358:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940605.091998:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944840960 00000100:00100000:0.0:1788940605.092049:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944840960 00000100:00100000:0.0:1788940605.092103:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788940605.092112:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039970450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944840960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788940605.092148:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788940605.092210:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039970450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944840960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940605.092216:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788940605.094162:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944840960:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788940605.747365:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940606.107466:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944841216:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.107551:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940606.107598:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944841728:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.107630:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940606.107652:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944842240:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.107670:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940606.107695:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788940606.107701:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944841088:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.107938:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940606.107964:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944841600:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.108031:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940606.108051:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944842112:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.108074:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940606.108091:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944842624:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.108108:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940606.108132:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944841344:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.108153:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940606.108171:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944841856:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.108190:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940606.108205:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944842368:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.108222:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940606.108238:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788940606.108243:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944841472:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.108282:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940606.108294:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944841984:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.108323:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940606.108341:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944842496:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.108359:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940606.108391:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944841088 00000100:00100000:2.0:1788940606.108400:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944841088 00000100:00100000:2.0:1788940606.108446:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788940606.108455:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944841088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.108505:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944841088:12345-0@lo:400:kworker.0 Request processed in 51us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940606.108513:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788940606.108557:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944841600 00000100:00100000:2.0:1788940606.108561:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944841600 00000100:00100000:2.0:1788940606.108582:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944841344 00000100:00100000:2.0:1788940606.108585:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944841344 00000100:00100000:2.0:1788940606.108598:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788940606.110634:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944841600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.111616:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944841600:12345-0@lo:400:kworker.0 Request processed in 2108us (2680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940606.111629:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788940606.111663:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788940606.111672:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944841344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.112544:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944841344:12345-0@lo:400:kworker.0 Request processed in 859us (4374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940606.112554:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788940606.112590:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944842112 00000100:00100000:2.0:1788940606.112601:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944842112 00000100:00100000:2.0:1788940606.112645:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944842624 00000100:00100000:2.0:1788940606.112660:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944842624 00000100:00100000:2.0:1788940606.112679:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944841984 00000100:00100000:2.0:1788940606.112682:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944841984 00000100:00100000:2.0:1788940606.112696:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944842496 00000100:00100000:2.0:1788940606.112699:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944842496 00000100:00100000:2.0:1788940606.112712:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788940606.112974:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940606.112979:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940606.113216:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940606.113234:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944842752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940606.113941:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940606.113954:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944842880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940606.114022:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944842112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940606.120643:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940606.120705:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944842880 00000100:00100000:3.0:1788940606.122941:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944842880 00000100:00100000:3.0:1788940606.123041:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788940606.123052:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875839944842880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788940606.123095:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940606.123179:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875839944842880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (2543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940606.123187:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1788940606.123275:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03588f480 x1875839944842880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940606.123296:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944842880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940606.124496:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788940606.124511:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944842624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940606.124586:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944842624:12345-0@lo:400:kworker.0 Request processed in 80us (16476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940606.124593:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788940606.124613:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788940606.124621:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944841984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940606.124649:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944841984:12345-0@lo:400:kworker.0 Request processed in 30us (16325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940606.124655:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788940606.124667:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788940606.124673:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944842496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940606.124702:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944842496:12345-0@lo:400:kworker.0 Request processed in 29us (16342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940606.124708:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788940606.124896:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944841216 00000100:00100000:3.0:1788940606.124906:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944841216 00000100:00100000:3.0:1788940606.124932:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944841728 00000100:00100000:3.0:1788940606.124944:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944841728 00000100:00100000:3.0:1788940606.124971:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944842240 00000100:00100000:3.0:1788940606.124974:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944842240 00000100:00100000:3.0:1788940606.124986:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944841856 00000100:00100000:3.0:1788940606.124989:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944841856 00000100:00100000:3.0:1788940606.125012:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944842368 00000100:00100000:3.0:1788940606.125015:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944842368 00000100:00100000:3.0:1788940606.125024:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944841472 00000100:00100000:3.0:1788940606.125026:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944841472 00000100:00100000:3.0:1788940606.125037:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788940606.125042:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944841216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940606.125075:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944841216:12345-0@lo:400:kworker.0 Request processed in 33us (17525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940606.125081:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788940606.125093:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788940606.125099:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944841728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940606.125124:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944841728:12345-0@lo:400:kworker.0 Request processed in 27us (17494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940606.125129:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788940606.125139:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788940606.125144:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944842240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940606.125168:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944842240:12345-0@lo:400:kworker.0 Request processed in 25us (17497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940606.125173:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788940606.125182:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788940606.125187:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944841856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940606.125306:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944841856:12345-0@lo:400:kworker.0 Request processed in 119us (17114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940606.125318:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788940606.125331:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788940606.125337:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944842368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940606.125365:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944842368:12345-0@lo:400:kworker.0 Request processed in 29us (17142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940606.125370:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788940606.125380:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788940606.125385:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944841472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940606.125411:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944841472:12345-0@lo:400:kworker.0 Request processed in 26us (17129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940606.125417:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1788940606.125443:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788940606.125447:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940606.126122:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944841472:0@lo:400:kworker.0 00010000:00080000:2.0:1788940606.126139:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f70380 x1875839944841984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940606.126150:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944841984:0@lo:400:kworker.0 00010000:00080000:2.0:1788940606.126161:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f73100 x1875839944842496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940606.126170:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944842496:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.126182:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944841344:0@lo:400:kworker.0 00010000:00080000:2.0:1788940606.126614:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f71500 x1875839944841856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940606.126628:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944841856:0@lo:400:kworker.0 00010000:00080000:2.0:1788940606.126646:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f71180 x1875839944842368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940606.126655:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944842368:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.126873:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944841088:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.126897:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944841600:0@lo:400:kworker.0 00010000:00080000:2.0:1788940606.126924:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0012ad880 x1875839944842624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940606.126932:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944842624:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.126944:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944841216:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.126955:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944841728:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.126966:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944842240:0@lo:400:kworker.0 00000100:00100000:2.0:1788940606.127053:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944842112:12345-0@lo:400:kworker.0 Request processed in 13038us (18977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940606.127062:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788940606.127294:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f72300 x1875839944842112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940606.127304:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944842112:0@lo:400:kworker.0 00000100:00100000:0.0:1788940606.131873:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940606.131932:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944842752 00000100:00100000:1.0:1788940606.131941:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944842752 00000100:00100000:1.0:1788940606.131991:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788940606.132011:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944842752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940606.132038:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940606.132088:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944842752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940606.132095:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1788940606.132348:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a2ca80 x1875839944842752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940606.132368:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944842752:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940606.747355:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940607.771366:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940608.668615:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944843008:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940608.668705:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940608.669466:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944843008 00000100:00100000:3.0:1788940608.669477:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944843008 00000100:00100000:3.0:1788940608.669546:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788940608.669559:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944843008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788940608.669600:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788940608.669840:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944843008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 283us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940608.669847:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788940608.670932:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944843008:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788940608.796570:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940609.179612:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944843136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940609.179712:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940609.180183:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944843264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940609.180231:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940609.180306:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944843136 00000100:00100000:3.0:1788940609.180318:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944843136 00000100:00100000:3.0:1788940609.180463:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944843264 00000100:00100000:3.0:1788940609.180468:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944843264 00000100:00100000:3.0:1788940609.180491:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788940609.180502:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944843136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940609.180543:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940609.180596:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944843136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940609.180604:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788940609.180623:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788940609.180630:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944843264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788940609.180640:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940609.180667:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944843264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940609.180674:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788940609.180693:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788940609.180734:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03588ea00 x1875839944843264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940609.180757:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944843264:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788940609.180943:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03588d500 x1875839944843136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940609.180960:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944843136:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788940609.821558:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940609.868174:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940609.868233:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940609.868347:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940609.868416:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921695104 00000100:00100000:1.0:1788940609.868430:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921695104 00000100:00100000:1.0:1788940609.868503:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 292 00000100:00100000:1.0:1788940609.868516:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2405:x1875839921695104:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940609.868624:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2405:x1875839921695104:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 110us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940609.868633:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 292 00000100:00100000:2.0:1788940609.875716:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921695360 00000100:00100000:2.0:1788940609.875739:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921695360 00000100:00100000:2.0:1788940609.875834:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921695232 00000100:00100000:2.0:1788940609.875838:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921695232 00000100:00100000:2.0:1788940609.875873:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 136 00000100:00100000:2.0:1788940609.875885:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921695360:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940609.876011:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921695360:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 128us (7777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940609.876038:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 136 00000100:00100000:2.0:1788940609.876060:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 137 00000100:00100000:2.0:1788940609.876067:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+6:2405:x1875839921695232:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940609.876096:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+6:2405:x1875839921695232:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 30us (7750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940609.876102:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 137 00000100:00080000:0.0:1788940609.876770:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940609.876777:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788940610.204460:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940610.204484:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944843392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940610.204573:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940610.204773:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944843392 00000100:00100000:2.0:1788940610.204781:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944843392 00000100:00100000:2.0:1788940610.204829:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788940610.204839:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944843392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940610.204869:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940610.204924:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944843392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940610.204931:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788940610.205063:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944843392:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788940610.849744:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940611.231741:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944843520:0@lo:400:kworker.0 00000100:00100000:1.0:1788940611.231814:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940611.231858:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944844032:0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.231982:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944843648:0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.232014:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940611.232038:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944844160:0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.232075:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940611.232101:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944844672:0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.232130:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940611.232148:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944845184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940611.232172:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940611.232198:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788940611.232229:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944843776:0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.232288:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940611.232314:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944844288:0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.232343:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940611.232375:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944844800:0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.232404:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940611.232447:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944843648 00000100:00100000:2.0:1788940611.232462:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944843648 00000100:00100000:2.0:1788940611.232510:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944844160 00000100:00100000:2.0:1788940611.232513:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944844160 00000100:00100000:2.0:1788940611.232541:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944844672 00000100:00100000:2.0:1788940611.232544:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944844672 00000100:00100000:2.0:1788940611.232564:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944844288 00000100:00100000:2.0:1788940611.232567:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944844288 00000100:00100000:2.0:1788940611.232578:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944844800 00000100:00100000:2.0:1788940611.232587:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944844800 00000100:00100000:2.0:1788940611.232603:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788940611.232611:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944843648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.232675:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944843648:12345-0@lo:400:kworker.0 Request processed in 63us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940611.232689:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788940611.232706:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788940611.232713:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944844160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.232740:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944844160:12345-0@lo:400:kworker.0 Request processed in 28us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940611.232745:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788940611.232756:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788940611.232763:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944844672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.232795:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944844672:12345-0@lo:400:kworker.0 Request processed in 34us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940611.232802:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788940611.232813:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788940611.232818:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944844288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.232842:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944844288:12345-0@lo:400:kworker.0 Request processed in 24us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940611.232848:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788940611.232857:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788940611.232875:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944844800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.232899:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944844800:12345-0@lo:400:kworker.0 Request processed in 37us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940611.232905:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788940611.232927:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944845184 00000100:00100000:2.0:1788940611.232931:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944845184 00000100:00100000:2.0:1788940611.232970:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788940611.232976:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944845184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940611.233001:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940611.233031:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944845184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940611.233037:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788940611.233054:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944843776 00000100:00100000:2.0:1788940611.233057:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944843776 00000100:00100000:2.0:1788940611.233081:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788940611.233087:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944843776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.233116:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944843776:12345-0@lo:400:kworker.0 Request processed in 30us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940611.233128:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1788940611.233153:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940611.233157:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940611.233159:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940611.233191:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944843776:0@lo:400:kworker.0 00010000:00080000:2.0:1788940611.233203:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0042b3800 x1875839944844288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940611.233213:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944844288:0@lo:400:kworker.0 00010000:00080000:2.0:1788940611.233224:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0042b3b80 x1875839944844800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940611.233232:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944844800:0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.233241:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944843648:0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.233249:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944844160:0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.233278:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944844672:0@lo:400:kworker.0 00010000:00080000:2.0:1788940611.233288:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0012ad180 x1875839944845184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940611.233301:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944845184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940611.233506:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944843520 00000100:00100000:0.0:1788940611.233511:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944843520 00000100:00100000:0.0:1788940611.233548:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788940611.233555:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944843520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940611.233589:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944843520:12345-0@lo:400:kworker.0 Request processed in 35us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940611.233595:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788940611.233776:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940611.233807:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944844544:0@lo:400:kworker.0 00000100:00100000:1.0:1788940611.233831:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940611.233856:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944845056:0@lo:400:kworker.0 00000100:00100000:0.0:1788940611.233932:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944844032 00000100:00100000:0.0:1788940611.233937:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944844032 00000100:00100000:0.0:1788940611.233969:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788940611.233976:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944844032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940611.234006:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944844032:12345-0@lo:400:kworker.0 Request processed in 31us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940611.234012:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788940611.234076:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940611.234122:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944843520:0@lo:400:kworker.0 00000100:00100000:1.0:1788940611.234131:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944844032:0@lo:400:kworker.0 00000100:00100000:1.0:1788940611.234148:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788940611.234155:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944843904:0@lo:400:kworker.0 00000100:00100000:1.0:1788940611.234178:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940611.234196:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944844416:0@lo:400:kworker.0 00000100:00100000:1.0:1788940611.234226:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940611.234241:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944844928:0@lo:400:kworker.0 00000100:00100000:1.0:1788940611.234281:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940611.234313:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944843904 00000100:00100000:1.0:1788940611.234316:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944843904 00000100:00100000:1.0:1788940611.234345:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788940611.234441:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944844544 00000100:00100000:0.0:1788940611.234445:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944844544 00000100:00100000:0.0:1788940611.234468:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944845056 00000100:00100000:0.0:1788940611.234471:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944845056 00000100:00100000:0.0:1788940611.234479:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944844416 00000100:00100000:0.0:1788940611.234481:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944844416 00000100:00100000:0.0:1788940611.234491:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944844928 00000100:00100000:0.0:1788940611.234493:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944844928 00000100:00100000:0.0:1788940611.235995:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788940611.236015:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944844544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940611.236086:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944844544:12345-0@lo:400:kworker.0 Request processed in 80us (2254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940611.236136:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944843904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940611.236173:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944843904:12345-0@lo:400:kworker.0 Request processed in 1822us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940611.236180:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788940611.236251:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944845312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788940611.236296:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940611.236331:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944845312 00000100:00100000:1.0:1788940611.236337:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944845312 00000100:00100000:1.0:1788940611.236378:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788940611.236386:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875839944845312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788940611.236401:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940611.236435:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875839944845312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940611.236441:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788940611.236472:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0042b3800 x1875839944845312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940611.236489:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944845312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788940611.236541:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944843904:0@lo:400:kworker.0 00010000:00080000:1.0:1788940611.236562:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0042b0380 x1875839944844544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940611.236579:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944844544:0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.239151:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788940611.239177:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944845056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.239280:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944845056:12345-0@lo:400:kworker.0 Request processed in 116us (5209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940611.239288:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788940611.239326:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788940611.239333:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944844416:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788940611.239456:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0042b1880 x1875839944845056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940611.239471:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944845056:0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.239604:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944844416:12345-0@lo:400:kworker.0 Request processed in 272us (5377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940611.239611:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788940611.239624:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788940611.239631:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944844928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940611.239660:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944844928:12345-0@lo:400:kworker.0 Request processed in 30us (5378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940611.239665:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788940611.239984:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940611.239989:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940611.240059:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0042b0a80 x1875839944844416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940611.240070:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944844416:0@lo:400:kworker.0 00010000:00080000:1.0:1788940611.240081:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0042b2300 x1875839944844928/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940611.240089:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944844928:0@lo:400:kworker.0 00000100:00100000:0.0:1788940611.251979:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00010000:3.0:1788940611.868214:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940612.892159:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940613.788043:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940613.788068:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944845440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788940613.788154:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940613.788415:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944845440 00000100:00100000:0.0:1788940613.788425:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944845440 00000100:00100000:0.0:1788940613.788478:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788940613.789200:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944845440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788940613.789758:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788940613.789847:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944845440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1359us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940613.789855:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788940613.789969:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944845440:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788940613.919141:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940614.299522:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944845568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940614.299589:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940614.299663:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944845568 00000100:00100000:1.0:1788940614.299671:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944845568 00000100:00100000:1.0:1788940614.299722:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788940614.299733:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944845568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788940614.299763:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940614.299802:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944845568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940614.299808:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788940614.299829:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940614.299858:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06100380 x1875839944845568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940630 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940614.299891:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944845568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940614.303405:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944845696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940614.303468:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940614.303526:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944845696 00000100:00100000:3.0:1788940614.303539:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944845696 00000100:00100000:3.0:1788940614.303617:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788940614.303626:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944845696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940614.303648:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940614.303686:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944845696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940614.303692:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1788940614.303711:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788940614.303735:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a2d500 x1875839944845696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940630 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940614.303752:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944845696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788940614.940036:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940614.950203:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940614.950253:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940614.950309:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940614.950340:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921695744 00000100:00100000:1.0:1788940614.950350:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921695744 00000100:00100000:1.0:1788940614.950411:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921695616 00000100:00100000:1.0:1788940614.950415:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921695616 00000100:00100000:1.0:1788940614.950438:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 144 00000100:00100000:1.0:1788940614.950448:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921695744:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940614.950538:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921695744:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 90us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940614.950545:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 144 00000100:00100000:1.0:1788940614.950563:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 145 00000100:00100000:1.0:1788940614.950570:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921695616:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940614.950595:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921695616:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 26us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940614.950600:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 145 00000100:00100000:3.0:1788940614.950855:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921695488 00000100:00100000:3.0:1788940614.950861:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921695488 00000100:00100000:3.0:1788940614.950963:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 294 00000100:00100000:3.0:1788940614.950972:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2404:x1875839921695488:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940614.951007:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2404:x1875839921695488:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 37us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940614.951013:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 294 00000100:00080000:3.0:1788940614.951044:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940614.951049:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788940615.324624:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944845824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788940615.324706:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940615.325853:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944845824 00000100:00100000:0.0:1788940615.325866:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944845824 00000100:00100000:0.0:1788940615.325935:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788940615.325946:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944845824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788940615.325983:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788940615.326046:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944845824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940615.326053:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788940615.326217:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944845824:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788940615.967863:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940616.347809:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944845952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940616.347924:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940616.348199:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944845952 00000100:00100000:1.0:1788940616.348208:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944845952 00000100:00100000:1.0:1788940616.348296:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788940616.348307:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944845952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940616.348359:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940616.348407:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944845952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940616.348416:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788940616.348633:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944846464:0@lo:400:kworker.0 00000100:00100000:1.0:1788940616.348662:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940616.348682:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944846976:0@lo:400:kworker.0 00000100:00100000:1.0:1788940616.348706:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940616.348723:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944847488:0@lo:400:kworker.0 00000100:00100000:1.0:1788940616.348739:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788940616.348772:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f73800 x1875839944845952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940616.348794:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944845952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940616.348813:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788940616.348819:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944846080:0@lo:400:kworker.0 00000100:00100000:1.0:1788940616.348849:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940616.348873:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06102680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944846592:0@lo:400:kworker.0 00000100:00100000:1.0:1788940616.348915:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940616.348934:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944847104:0@lo:400:kworker.0 00000100:00100000:1.0:1788940616.348955:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940616.348981:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944846464 00000100:00100000:1.0:1788940616.348985:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944846464 00000100:00100000:1.0:1788940616.349019:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788940616.349027:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944846464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940616.349078:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944846464:12345-0@lo:400:kworker.0 Request processed in 52us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940616.349085:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788940616.349105:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944846976 00000100:00100000:1.0:1788940616.349109:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944846976 00000100:00100000:1.0:1788940616.349136:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944847488 00000100:00100000:1.0:1788940616.349138:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944847488 00000100:00100000:1.0:1788940616.349152:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944847104 00000100:00100000:1.0:1788940616.349155:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944847104 00000100:00100000:1.0:1788940616.349170:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788940616.349177:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944846976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940616.349209:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944846976:12345-0@lo:400:kworker.0 Request processed in 33us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940616.349215:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788940616.349225:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788940616.349230:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944847488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940616.349253:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944847488:12345-0@lo:400:kworker.0 Request processed in 23us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940616.349278:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788940616.349288:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788940616.349293:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944847104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940616.349316:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944847104:12345-0@lo:400:kworker.0 Request processed in 23us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940616.349321:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788940616.349341:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944846080 00000100:00100000:1.0:1788940616.349345:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944846080 00000100:00100000:1.0:1788940616.349368:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788940616.349380:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944846080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940616.349408:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944846080:12345-0@lo:400:kworker.0 Request processed in 30us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940616.349414:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788940616.349438:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944846592 00000100:00100000:1.0:1788940616.349442:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944846592 00000100:00100000:1.0:1788940616.349469:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788940616.349476:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944846592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940616.349507:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944846592:12345-0@lo:400:kworker.0 Request processed in 32us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940616.349513:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788940616.349556:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944846080:0@lo:400:kworker.0 00000100:00100000:1.0:1788940616.349568:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06102680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944846592:0@lo:400:kworker.0 00010000:00080000:1.0:1788940616.349579:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0042b1880 x1875839944847104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940616.349590:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944847104:0@lo:400:kworker.0 00000100:00100000:1.0:1788940616.349600:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944846464:0@lo:400:kworker.0 00010000:00080000:1.0:1788940616.349609:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0042b0a80 x1875839944846976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940616.349618:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944846976:0@lo:400:kworker.0 00010000:00080000:1.0:1788940616.349626:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ee0000 x1875839944847488/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940616.349635:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944847488:0@lo:400:kworker.0 00000100:00100000:3.0:1788940616.353319:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944847616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940616.353441:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940616.353519:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944846208:0@lo:400:kworker.0 00000100:00100000:3.0:1788940616.353551:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940616.353578:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944846720:0@lo:400:kworker.0 00000100:00100000:3.0:1788940616.353602:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940616.353621:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944847232:0@lo:400:kworker.0 00000100:00100000:3.0:1788940616.353643:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940616.353665:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788940616.353673:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944846336:0@lo:400:kworker.0 00000100:00100000:3.0:1788940616.353701:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940616.353724:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944846848:0@lo:400:kworker.0 00000100:00100000:3.0:1788940616.353746:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940616.353766:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944847360:0@lo:400:kworker.0 00000100:00100000:3.0:1788940616.353786:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788940616.353821:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940616.353829:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940616.353852:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944847616 00000100:00100000:3.0:1788940616.353864:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944847616 00000100:00100000:3.0:1788940616.353942:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788940616.353954:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944847616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788940616.353986:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940616.354038:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944847616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940616.354046:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788940616.354083:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944846208 00000100:00100000:3.0:1788940616.354095:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944846208 00000100:00100000:3.0:1788940616.354118:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944846720 00000100:00100000:3.0:1788940616.354121:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944846720 00000100:00100000:3.0:1788940616.354142:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944847232 00000100:00100000:3.0:1788940616.354145:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944847232 00000100:00100000:3.0:1788940616.354160:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944846848 00000100:00100000:3.0:1788940616.354162:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944846848 00000100:00100000:3.0:1788940616.354172:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944847360 00000100:00100000:3.0:1788940616.354174:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944847360 00000100:00100000:3.0:1788940616.354187:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788940616.354193:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944846208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940616.354229:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944846208:12345-0@lo:400:kworker.0 Request processed in 37us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940616.354235:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788940616.354245:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788940616.354251:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944846720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940616.354307:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944846720:12345-0@lo:400:kworker.0 Request processed in 56us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940616.354313:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788940616.354322:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788940616.354328:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944847232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940616.354349:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944847232:12345-0@lo:400:kworker.0 Request processed in 22us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940616.354355:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788940616.354363:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788940616.354368:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944846848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940616.354390:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944846848:12345-0@lo:400:kworker.0 Request processed in 22us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940616.354405:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788940616.354414:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788940616.354419:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944847360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940616.354442:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944847360:12345-0@lo:400:kworker.0 Request processed in 23us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940616.354447:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788940616.354474:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944846336 00000100:00100000:3.0:1788940616.354477:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944846336 00000100:00100000:3.0:1788940616.354504:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788940616.354510:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944846336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940616.354542:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944846336:12345-0@lo:400:kworker.0 Request processed in 32us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940616.354549:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1788940616.354569:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788940616.354572:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788940616.354613:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f71880 x1875839944847616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940616.354637:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944847616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940616.354674:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944846336:0@lo:400:kworker.0 00010000:00080000:3.0:1788940616.354685:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0042b2300 x1875839944846848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940616.354694:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944846848:0@lo:400:kworker.0 00010000:00080000:3.0:1788940616.354703:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0042b3800 x1875839944847360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940616.354725:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944847360:0@lo:400:kworker.0 00000100:00100000:3.0:1788940616.354738:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944846208:0@lo:400:kworker.0 00000100:00100000:3.0:1788940616.354748:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944846720:0@lo:400:kworker.0 00000100:00100000:3.0:1788940616.354757:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944847232:0@lo:400:kworker.0 00010000:00010000:2.0:1788940616.991336:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940618.011893:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940618.910472:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944847744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940618.910622:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940618.910762:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944847744 00000100:00100000:2.0:1788940618.910775:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944847744 00000100:00100000:2.0:1788940618.910890:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788940618.910906:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944847744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940618.910958:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788940618.911542:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944847744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 637us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940618.911553:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788940618.911762:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944847744:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788940619.043696:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940619.419429:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940619.419470:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944847872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940619.419565:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940619.419656:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944847872 00000100:00100000:1.0:1788940619.419667:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944847872 00000100:00100000:1.0:1788940619.419739:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788940619.419753:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944847872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788940619.419809:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940619.419862:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944847872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940619.419870:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1788940619.419910:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940619.419949:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ee0000 x1875839944847872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940619.419972:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944847872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940619.421923:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944848000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940619.422011:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940619.422996:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944848000 00000100:00100000:0.0:1788940619.423009:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944848000 00000100:00100000:0.0:1788940619.424282:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788940619.424304:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944848000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940619.424343:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940619.424451:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944848000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (2440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940619.424460:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1788940619.424803:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940619.430470:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ee0000 x1875839944848000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940619.430509:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944848000:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788940620.060319:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940620.093051:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940620.093121:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940620.093308:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921696000 00000100:00100000:3.0:1788940620.093323:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921696000 00000100:00100000:3.0:1788940620.093414:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 152 00000100:00100000:3.0:1788940620.093427:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:2406:x1875839921696000:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940620.093528:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:2406:x1875839921696000:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 104us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940620.093538:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 152 00000100:00080000:2.0:1788940620.095227:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940620.096773:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940620.097506:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921695872 00000100:00100000:0.0:1788940620.097523:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921695872 00000100:00100000:0.0:1788940620.097613:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 296 00000100:00100000:0.0:1788940620.098457:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2406:x1875839921695872:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940620.098674:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2406:x1875839921695872:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 1048us (5549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940620.098684:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 296 00000100:00100000:3.0:1788940620.098718:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921696128 00000100:00100000:3.0:1788940620.098727:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921696128 00000100:00100000:3.0:1788940620.098802:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 153 00000100:00100000:3.0:1788940620.098812:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921696128:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940620.098850:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921696128:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 41us (2093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940620.098993:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 153 00000100:00080000:1.0:1788940620.099235:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788940620.443955:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940620.443986:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944848128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788940620.444086:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940620.444291:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944848128 00000100:00100000:2.0:1788940620.444304:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944848128 00000100:00100000:2.0:1788940620.444373:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788940620.444384:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944848128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940620.444509:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940620.444832:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944848128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 449us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940620.444842:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788940620.445050:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944848128:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788940621.086598:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940621.467664:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944848640:0@lo:400:kworker.0 00000100:00100000:1.0:1788940621.467783:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940621.467847:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944849152:0@lo:400:kworker.0 00000100:00100000:1.0:1788940621.467891:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940621.467912:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944849664:0@lo:400:kworker.0 00000100:00100000:1.0:1788940621.467936:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940621.467971:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788940621.467976:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944848512:0@lo:400:kworker.0 00000100:00100000:1.0:1788940621.468005:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940621.468023:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944849024:0@lo:400:kworker.0 00000100:00100000:1.0:1788940621.468044:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940621.468064:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944849536:0@lo:400:kworker.0 00000100:00100000:1.0:1788940621.468085:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940621.468125:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944849152 00000100:00100000:1.0:1788940621.468137:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944849152 00000100:00100000:1.0:1788940621.468215:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944849664 00000100:00100000:1.0:1788940621.468220:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944849664 00000100:00100000:1.0:1788940621.468246:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788940621.468286:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944849152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940621.468351:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944849152:12345-0@lo:400:kworker.0 Request processed in 95us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940621.468358:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788940621.468378:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788940621.468384:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944849664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940621.468411:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944849664:12345-0@lo:400:kworker.0 Request processed in 28us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940621.468416:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788940621.468456:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944848640 00000100:00100000:1.0:1788940621.468460:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944848640 00000100:00100000:1.0:1788940621.468484:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944849024 00000100:00100000:1.0:1788940621.468487:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944849024 00000100:00100000:1.0:1788940621.468504:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944849536 00000100:00100000:1.0:1788940621.468506:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944849536 00000100:00100000:1.0:1788940621.468522:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788940621.468529:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944848640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940621.468564:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944848640:12345-0@lo:400:kworker.0 Request processed in 36us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940621.468570:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788940621.468582:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788940621.468588:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944849024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940621.468615:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944849024:12345-0@lo:400:kworker.0 Request processed in 28us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940621.468621:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788940621.468632:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788940621.468637:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944849536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940621.468663:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944849536:12345-0@lo:400:kworker.0 Request processed in 26us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940621.468669:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1788940621.468691:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940621.468696:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940621.468698:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940621.468733:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06103800 x1875839944849024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940621.468750:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944849024:0@lo:400:kworker.0 00010000:00080000:1.0:1788940621.468774:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06101500 x1875839944849536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940621.468782:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944849536:0@lo:400:kworker.0 00000100:00100000:1.0:1788940621.468791:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944848640:0@lo:400:kworker.0 00010000:00080000:1.0:1788940621.468799:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06100000 x1875839944849152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940621.468807:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944849152:0@lo:400:kworker.0 00010000:00080000:1.0:1788940621.468814:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06101880 x1875839944849664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940621.468821:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944849664:0@lo:400:kworker.0 00000100:00100000:2.0:1788940621.470496:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944848512 00000100:00100000:2.0:1788940621.470508:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944848512 00000100:00100000:2.0:1788940621.470575:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788940621.470586:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944848512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940621.470704:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944848512:12345-0@lo:400:kworker.0 Request processed in 121us (2697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940621.470713:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788940621.470772:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944848512:0@lo:400:kworker.0 00000100:00100000:0.0:1788940621.471480:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944848384:0@lo:400:kworker.0 00000100:00100000:0.0:1788940621.471548:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940621.471594:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944848896:0@lo:400:kworker.0 00000100:00100000:0.0:1788940621.471621:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940621.471648:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06102680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944849408:0@lo:400:kworker.0 00000100:00100000:0.0:1788940621.471671:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940621.471688:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944849920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940621.471713:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940621.471740:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788940621.471748:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944848256:0@lo:400:kworker.0 00000100:00100000:0.0:1788940621.471780:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940621.471801:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944848768:0@lo:400:kworker.0 00000100:00100000:0.0:1788940621.471826:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940621.471863:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944849280:0@lo:400:kworker.0 00000100:00100000:0.0:1788940621.471892:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940621.471913:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944849792:0@lo:400:kworker.0 00000100:00100000:0.0:1788940621.471932:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940621.471992:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944849920 00000100:00100000:0.0:1788940621.472001:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944849920 00000100:00100000:0.0:1788940621.472063:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788940621.472072:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944849920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940621.472115:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940621.472160:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944849920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940621.472167:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788940621.472189:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944849280 00000100:00100000:0.0:1788940621.472193:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944849280 00000100:00100000:0.0:1788940621.472231:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944849792 00000100:00100000:0.0:1788940621.472234:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944849792 00000100:00100000:0.0:1788940621.472245:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788940621.472250:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944849280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940621.472312:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944849280:12345-0@lo:400:kworker.0 Request processed in 62us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940621.472318:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788940621.472330:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788940621.472336:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944849792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940621.472362:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944849792:12345-0@lo:400:kworker.0 Request processed in 26us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940621.472368:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788940621.472389:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944848384 00000100:00100000:0.0:1788940621.472392:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944848384 00000100:00100000:0.0:1788940621.472408:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944848896 00000100:00100000:0.0:1788940621.472410:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944848896 00000100:00100000:0.0:1788940621.472420:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944849408 00000100:00100000:0.0:1788940621.472423:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944849408 00000100:00100000:0.0:1788940621.472434:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788940621.472446:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944848384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940621.472474:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944848384:12345-0@lo:400:kworker.0 Request processed in 29us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940621.472480:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788940621.472489:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788940621.472494:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944848896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940621.472514:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944848896:12345-0@lo:400:kworker.0 Request processed in 20us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940621.472520:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788940621.472530:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788940621.472535:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944849408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940621.472561:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944849408:12345-0@lo:400:kworker.0 Request processed in 26us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940621.472567:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:0.0:1788940621.472623:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940621.472642:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940621.472644:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940621.472669:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944848768 00000100:00100000:0.0:1788940621.472673:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944848768 00000100:00100000:0.0:1788940621.472701:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788940621.472708:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944848768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940621.472744:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944848768:12345-0@lo:400:kworker.0 Request processed in 37us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940621.472749:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788940621.472786:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944848768:0@lo:400:kworker.0 00010000:00080000:0.0:1788940621.472802:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06103b80 x1875839944849280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940621.472821:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944849280:0@lo:400:kworker.0 00010000:00080000:0.0:1788940621.472834:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06100700 x1875839944849792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940621.472843:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944849792:0@lo:400:kworker.0 00000100:00100000:0.0:1788940621.472864:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944848384:0@lo:400:kworker.0 00000100:00100000:0.0:1788940621.472875:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944848896:0@lo:400:kworker.0 00000100:00100000:0.0:1788940621.472883:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06102680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944849408:0@lo:400:kworker.0 00010000:00080000:0.0:1788940621.472892:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f71180 x1875839944849920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940621.472907:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944849920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940621.473289:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944848256 00000100:00100000:3.0:1788940621.473296:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944848256 00000100:00100000:3.0:1788940621.473335:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788940621.473342:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944848256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940621.473393:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944848256:12345-0@lo:400:kworker.0 Request processed in 52us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940621.473400:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788940621.473459:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944848256:0@lo:400:kworker.0 00000100:00100000:2.0:1788940621.476306:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940621.487687:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944850048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940621.487799:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940621.488815:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944850048 00000100:00100000:0.0:1788940621.488831:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944850048 00000100:00100000:0.0:1788940621.489061:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788940621.489075:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944850048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788940621.489114:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940621.489338:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944850048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 266us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940621.489347:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:2.0:1788940621.489598:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f64380 x1875839944850048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940621.489636:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944850048:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788940622.109970:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940623.134492:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788940623.180599:0:12005:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 03:57:01 (1788940621) === 00000100:00100000:3.0:1788940623.718645:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940623.719919:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921696256 00000100:00100000:0.0:1788940623.719938:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921696256 00000100:00100000:0.0:1788940623.720158:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 298 00000100:00100000:0.0:1788940623.720173:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:8774:x1875839921696256:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788940623.720630:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940623.720657:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584d400/0x9c34acc08badd22e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7164 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.720698:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584d400/0x9c34acc08badd22e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7164 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.720713:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584d400/0x9c34acc08badd22e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7164 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.720724:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584d400, rc 0) 00000100:00100000:0.0:1788940623.720974:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:8774:x1875839921696256:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 802us (2342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940623.720983:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 298 00000100:00100000:2.0:1788940623.737365:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940623.737898:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921696384 00000100:00100000:3.0:1788940623.737914:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921696384 00000100:00100000:3.0:1788940623.738134:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 299 00000100:00100000:3.0:1788940623.738149:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:8774:x1875839921696384:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788940623.738448:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:8774:x1875839921696384:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 302us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940623.738457:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 299 00000100:00100000:1.0:1788940623.743066:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940623.743367:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921696512 00000100:00100000:0.0:1788940623.743383:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921696512 00000100:00100000:0.0:1788940623.743478:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 300 00000100:00100000:0.0:1788940623.743493:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:8774:x1875839921696512:12345-192.168.202.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788940623.743726:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:8774:x1875839921696512:12345-192.168.202.25@tcp:503:mount.lustre.0 Request processed in 235us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940623.743736:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 300 00000100:00100000:2.0:1788940623.750211:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940623.750381:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921696640 00000100:00100000:3.0:1788940623.750396:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921696640 00000100:00100000:3.0:1788940623.750483:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 301 00000100:00100000:3.0:1788940623.750516:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:8778:x1875839921696640:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788940623.750743:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:8778:x1875839921696640:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 228us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940623.750751:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 301 00000100:00100000:1.0:1788940623.789718:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940623.789937:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921696768 00000100:00100000:3.0:1788940623.789953:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921696768 00000100:00100000:3.0:1788940623.790048:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 302 00000100:00100000:3.0:1788940623.790060:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:8778:x1875839921696768:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788940623.790344:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:8778:x1875839921696768:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 284us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940623.790353:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 302 00000100:00100000:1.0:1788940623.804760:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940623.805765:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921696896 00000100:00100000:0.0:1788940623.805784:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921696896 00000100:00100000:0.0:1788940623.805885:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 303 00000100:00100000:0.0:1788940623.805899:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:8778:x1875839921696896:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940623.806140:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:8778:x1875839921696896:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 243us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940623.806158:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 303 00000100:00100000:2.0:1788940623.817324:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940623.817587:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921697024 00000100:00100000:0.0:1788940623.817603:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921697024 00000100:00100000:0.0:1788940623.817696:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 304 00000100:00100000:0.0:1788940623.817711:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:8774:x1875839921697024:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788940623.817735:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940623.817761:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584c400/0x9c34acc08badd235 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7195 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.818304:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584c400/0x9c34acc08badd235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7195 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.818323:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584c400/0x9c34acc08badd235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7195 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.818336:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c400, rc 0) 00000100:00100000:0.0:1788940623.818432:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:8774:x1875839921697024:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 723us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940623.818441:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 304 00000100:00100000:1.0:1788940623.824579:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940623.824697:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921697152 00000100:00100000:3.0:1788940623.824713:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921697152 00000100:00100000:3.0:1788940623.824797:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 305 00000100:00100000:3.0:1788940623.824811:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:8774:x1875839921697152:12345-192.168.202.25@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788940623.824857:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788940623.824889:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788940623.824893:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788940623.824896:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788940623.824899:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788940623.824902:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788940623.830435:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:8774:x1875839921697152:12345-192.168.202.25@tcp:256:mount.lustre.0 Request processed in 5604us (5861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940623.830460:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 305 00000100:00100000:1.0:1788940623.842941:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940623.843380:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921697280 00000100:00100000:0.0:1788940623.843406:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921697280 00000100:00100000:0.0:1788940623.843481:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 306 00000100:00100000:0.0:1788940623.843494:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:8774:x1875839921697280:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788940623.843518:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940623.843542:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584c800/0x9c34acc08badd23c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc719c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.843680:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584c800/0x9c34acc08badd23c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc719c expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.843694:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584c800/0x9c34acc08badd23c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc719c expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.843705:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c800, rc 0) 00000100:00100000:0.0:1788940623.843786:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:8774:x1875839921697280:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 295us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940623.843800:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 306 00000100:00100000:3.0:1788940623.847775:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940623.848164:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921697408 00000100:00100000:0.0:1788940623.848179:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921697408 00000100:00100000:0.0:1788940623.848307:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 307 00000100:00100000:0.0:1788940623.848320:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:8774:x1875839921697408:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788940623.848533:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:8774:x1875839921697408:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 215us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940623.848543:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 307 00000100:00100000:2.0:1788940623.851908:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940623.852138:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921697536 00000100:00100000:1.0:1788940623.852153:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921697536 00000100:00100000:1.0:1788940623.852461:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 308 00000100:00100000:1.0:1788940623.852478:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:8774:x1875839921697536:12345-192.168.202.25@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788940623.853205:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:8774:x1875839921697536:12345-192.168.202.25@tcp:503:mount.lustre.0 Request processed in 727us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.854090:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 308 00000100:00100000:1.0:1788940623.858207:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940623.858423:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921697664 00000100:00100000:0.0:1788940623.858439:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921697664 00000100:00100000:0.0:1788940623.858515:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 309 00000100:00100000:0.0:1788940623.858528:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:8783:x1875839921697664:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940623.858771:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:8783:x1875839921697664:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 244us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940623.858781:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 309 00000100:00100000:3.0:1788940623.862722:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940623.863301:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921697792 00000100:00100000:1.0:1788940623.863316:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921697792 00000100:00100000:1.0:1788940623.863408:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 310 00000100:00100000:1.0:1788940623.863419:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:8783:x1875839921697792:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788940623.863630:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:8783:x1875839921697792:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 211us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.863640:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 310 00000100:00100000:2.0:1788940623.869390:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940623.869446:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940623.869545:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940623.879904:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940623.880029:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921697920 00000100:00100000:1.0:1788940623.880043:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921697920 00000100:00100000:1.0:1788940623.880103:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921698176 00000100:00100000:1.0:1788940623.880107:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921698176 00000100:00100000:1.0:1788940623.880127:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921698560 00000100:00100000:1.0:1788940623.880131:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921698560 00000100:00100000:1.0:1788940623.880181:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 160 00000100:00100000:1.0:1788940623.880193:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:2405:x1875839921698560:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940623.880324:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:2405:x1875839921698560:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 132us (10777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.880333:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 160 00000100:00100000:1.0:1788940623.880354:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:1.0:1788940623.880359:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875839921697920:12345-192.168.202.25@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788940623.880387:0:8517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3fe11818-a425-4818-b40c-4d2e4f9916d8@192.168.202.25@tcp t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:1.0:1788940623.880445:0:8517:0:(genops.c:1393:class_connect()) connect: client 3fe11818-a425-4818-b40c-4d2e4f9916d8, cookie 0x9c34acc08badd243 00000004:00100000:1.0:1788940623.880482:0:8517:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1788940623.880893:0:8517:0:(import.c:65:import_set_state_nolock()) ffff91d020c96000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940623.880934:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2403:x1875839921697920:12345-192.168.202.25@tcp:38:mount.lustre.0 Request processed in 573us (11563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.880941:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:1.0:1788940623.880957:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:1.0:1788940623.880962:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875839921698176:12345-192.168.202.25@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788940623.880979:0:8517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 3fe11818-a425-4818-b40c-4d2e4f9916d8@192.168.202.25@tcp t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:1.0:1788940623.881007:0:8517:0:(genops.c:1393:class_connect()) connect: client 3fe11818-a425-4818-b40c-4d2e4f9916d8, cookie 0x9c34acc08badd24a 00000004:00100000:1.0:1788940623.881021:0:8517:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:1.0:1788940623.881087:0:8517:0:(import.c:65:import_set_state_nolock()) ffff91d020c91800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940623.881113:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2403:x1875839921698176:12345-192.168.202.25@tcp:38:mount.lustre.0 Request processed in 149us (11666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.881120:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00080000:0.0:1788940623.884531:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940623.890852:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921698688 00000100:00100000:1.0:1788940623.890878:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921698688 00000100:00100000:2.0:1788940623.891074:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00080000:0.0:1788940623.891123:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788940623.893289:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940623.893730:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921698048 00000100:00100000:1.0:1788940623.893746:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921698048 00000100:00100000:1.0:1788940623.893846:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 161 00000100:00100000:1.0:1788940623.893862:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921698688:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940623.893997:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921698688:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 139us (14108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.894006:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 161 00000100:00100000:1.0:1788940623.894029:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:1.0:1788940623.894037:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:0:x1875839921698048:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788940623.894072:0:8517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788940623.894154:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:0:x1875839921698048:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 118us (3090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.894161:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00080000:1.0:1788940623.904524:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940623.904953:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940623.905005:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921698304 00000100:00100000:2.0:1788940623.905018:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921698304 00000100:00100000:2.0:1788940623.905094:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921698432 00000100:00100000:2.0:1788940623.905097:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921698432 00000100:00100000:2.0:1788940623.905125:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:2.0:1788940623.905137:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:0:x1875839921698304:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788940623.905194:0:8517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788940623.906062:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:1.0:1788940623.906084:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:8774:x1875839921698432:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788940623.906112:0:9713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788940623.906197:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:8774:x1875839921698432:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 123us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.906206:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00080000:1.0:1788940623.906278:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788940623.906774:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:0:x1875839921698304:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 1635us (13494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940623.906782:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:3.0:1788940623.909636:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940623.909742:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921698816 00000100:00100000:1.0:1788940623.909757:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921698816 00000100:00100000:1.0:1788940623.909847:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:1.0:1788940623.909861:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:8774:x1875839921698816:12345-192.168.202.25@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788940623.910002:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:8774:x1875839921698816:12345-192.168.202.25@tcp:40:mount.lustre.0 Request processed in 144us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.910012:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:3.0:1788940623.912923:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940623.912962:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940623.913800:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940623.914021:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921699200 00000100:00100000:1.0:1788940623.914038:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921699200 00000100:00100000:1.0:1788940623.914122:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:1.0:1788940623.914135:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:8774:x1875839921699200:12345-192.168.202.25@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788940623.914765:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:8774:x1875839921699200:12345-192.168.202.25@tcp:900:mount.lustre.0 Request processed in 625us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.914778:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:2.0:1788940623.916808:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921698944 00000100:00100000:2.0:1788940623.916842:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921698944 00000100:00100000:2.0:1788940623.916913:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921699072 00000100:00100000:2.0:1788940623.916918:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921699072 00000100:00100000:2.0:1788940623.916952:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:2.0:1788940623.916962:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1875839921698944:12345-192.168.202.25@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788940623.917019:0:8439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3fe11818-a425-4818-b40c-4d2e4f9916d8@192.168.202.25@tcp t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:2.0:1788940623.917063:0:8439:0:(genops.c:1393:class_connect()) connect: client 3fe11818-a425-4818-b40c-4d2e4f9916d8, cookie 0x9c34acc08badd251 00002000:00100000:2.0:1788940623.917095:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3fe11818-a425-4818-b40c-4d2e4f9916d8/ffff91d03593f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788940623.917117:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000100:00100000:1.0:1788940623.917673:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:1.0:1788940623.917682:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1875839921699072:12345-192.168.202.25@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788940623.917712:0:8437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3fe11818-a425-4818-b40c-4d2e4f9916d8@192.168.202.25@tcp t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:1.0:1788940623.917740:0:8437:0:(genops.c:1393:class_connect()) connect: client 3fe11818-a425-4818-b40c-4d2e4f9916d8, cookie 0x9c34acc08badd258 00002000:00100000:1.0:1788940623.917748:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3fe11818-a425-4818-b40c-4d2e4f9916d8/ffff91d020c96800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788940623.917763:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788940623.917819:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788940623.917872:0:8437:0:(import.c:65:import_set_state_nolock()) ffff91d020c90000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940623.917977:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2403:x1875839921699072:12345-192.168.202.25@tcp:8:mount.lustre.0 Request processed in 282us (4170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.917986:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00002000:00080000:2.0:1788940623.918084:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788940623.918105:0:8439:0:(import.c:65:import_set_state_nolock()) ffff91d03593a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940623.918134:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2403:x1875839921698944:12345-192.168.202.25@tcp:8:mount.lustre.0 Request processed in 1173us (5170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940623.918141:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:3.0:1788940623.921374:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940623.922806:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921699328 00000100:00100000:2.0:1788940623.922838:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921699328 00000100:00100000:2.0:1788940623.922953:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:2.0:1788940623.922979:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:8774:x1875839921699328:12345-192.168.202.25@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788940623.923132:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788940623.923318:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:8774:x1875839921699328:12345-192.168.202.25@tcp:33:mount.lustre.0 Request processed in 353us (1959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940623.923328:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:2.0:1788940624.034000:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944850176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788940624.034111:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940624.034374:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944850176 00000100:00100000:3.0:1788940624.034386:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944850176 00000100:00100000:3.0:1788940624.034471:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788940624.034483:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944850176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788940624.034522:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788940624.034808:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944850176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 327us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940624.034817:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788940624.035723:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944850176:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788940624.167986:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940624.539865:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940624.539903:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944850304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940624.540028:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940624.540135:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944850432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940624.540163:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940624.540201:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944850304 00000100:00100000:1.0:1788940624.540214:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944850304 00000100:00080000:0.0:1788940624.540309:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940624.540318:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944850432 00000100:00100000:1.0:1788940624.540322:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944850432 00000100:00100000:1.0:1788940624.540348:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788940624.540427:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944850304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940624.540460:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940624.540520:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944850304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (491us total) trans 0 rc 0/0 00000100:00080000:3.0:1788940624.541656:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788940624.541732:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf0610ad80 x1875839944850304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940624.541761:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944850304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940624.544682:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788940624.544726:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944850432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788940624.544772:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940624.544922:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944850432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 221us (4758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940624.544931:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1788940624.545507:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f70000 x1875839944850432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940624.545551:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944850432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940624.561647:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1788940625.185856:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940625.563806:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944850560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788940625.563928:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940625.565695:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944850560 00000100:00100000:0.0:1788940625.565716:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944850560 00000100:00100000:0.0:1788940625.565822:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788940625.565836:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944850560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788940625.565889:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788940625.565998:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944850560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 164us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940625.566007:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788940625.566077:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944850560:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788940626.204769:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940626.588463:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940626.588496:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944850688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940626.588616:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940626.588707:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944850688 00000100:00100000:0.0:1788940626.588737:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944850688 00000100:00100000:0.0:1788940626.588825:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788940626.588838:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944850688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940626.588882:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940626.588942:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944850688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940626.588951:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1788940626.589006:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f66d80 x1875839944850688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940626.589028:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944850688:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788940626.589306:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940626.592825:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944850816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940626.592949:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940626.593053:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944850816 00000100:00100000:3.0:1788940626.593063:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944850816 00000100:00100000:3.0:1788940626.593142:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788940626.593154:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944850816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788940626.593185:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940626.593240:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944850816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940626.593248:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788940626.593305:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788940626.593343:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06ec5c00 x1875839944850816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940626.598480:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944850816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940626.609997:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944851072:0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.610087:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940626.610137:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944851584:0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.610161:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940626.610181:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf084dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944852096:0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.610202:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940626.610236:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788940626.610242:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944851200:0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.610294:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940626.610313:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf084dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944851712:0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.610335:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940626.610351:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf084ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944852224:0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.610405:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940626.610438:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944851072 00000100:00100000:3.0:1788940626.610448:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944851072 00000100:00100000:3.0:1788940626.610493:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944851584 00000100:00100000:3.0:1788940626.610495:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944851584 00000100:00100000:3.0:1788940626.610516:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944852096 00000100:00100000:3.0:1788940626.610518:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944852096 00000100:00100000:3.0:1788940626.610546:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944851712 00000100:00100000:3.0:1788940626.610548:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944851712 00000100:00100000:3.0:1788940626.610561:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944852224 00000100:00100000:3.0:1788940626.610563:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944852224 00000100:00100000:3.0:1788940626.610579:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788940626.610589:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944851072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.610652:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944851072:12345-0@lo:400:kworker.0 Request processed in 64us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940626.610661:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788940626.610686:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788940626.610691:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944851584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.610720:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944851584:12345-0@lo:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940626.610726:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788940626.610738:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788940626.610744:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944852096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.610772:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944852096:12345-0@lo:400:kworker.0 Request processed in 29us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940626.610779:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788940626.610791:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788940626.610796:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944851712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.610847:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944851712:12345-0@lo:400:kworker.0 Request processed in 50us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940626.610854:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788940626.610866:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788940626.610872:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944852224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.610901:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944852224:12345-0@lo:400:kworker.0 Request processed in 29us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940626.610907:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788940626.610938:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944851200 00000100:00100000:3.0:1788940626.610942:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944851200 00000100:00100000:3.0:1788940626.610970:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788940626.610976:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944851200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.611011:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944851200:12345-0@lo:400:kworker.0 Request processed in 35us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940626.611018:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788940626.611066:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944851200:0@lo:400:kworker.0 00010000:00080000:3.0:1788940626.611083:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf084dce00 x1875839944851712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940626.611095:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf084dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944851712:0@lo:400:kworker.0 00010000:00080000:3.0:1788940626.611104:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf084ddc00 x1875839944852224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940626.611111:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf084ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944852224:0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.611122:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944851072:0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.611133:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944851584:0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.611153:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf084dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944852096:0@lo:400:kworker.0 00000100:00080000:3.0:1788940626.611202:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788940626.611207:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940626.611223:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944851328:0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.611252:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940626.611299:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf084df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944851840:0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.611325:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940626.611348:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788940626.611354:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944850944:0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.611380:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940626.611403:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944851456:0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.611423:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940626.611439:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf084de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944851968:0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.611456:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940626.611482:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944851328 00000100:00100000:3.0:1788940626.611486:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944851328 00000100:00100000:3.0:1788940626.611513:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788940626.611519:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944851328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.611555:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944851328:12345-0@lo:400:kworker.0 Request processed in 36us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940626.611562:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788940626.611580:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944851840 00000100:00100000:3.0:1788940626.611584:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944851840 00000100:00100000:3.0:1788940626.611614:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944851968 00000100:00100000:3.0:1788940626.611617:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944851968 00000100:00100000:3.0:1788940626.611637:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788940626.611652:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944851840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.611685:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944851840:12345-0@lo:400:kworker.0 Request processed in 35us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940626.611692:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788940626.611707:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788940626.611713:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944851968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.611739:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944851968:12345-0@lo:400:kworker.0 Request processed in 26us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940626.611746:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788940626.611765:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944850944 00000100:00100000:3.0:1788940626.611769:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944850944 00000100:00100000:3.0:1788940626.611798:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788940626.611818:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944850944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.611848:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944850944:12345-0@lo:400:kworker.0 Request processed in 45us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940626.611854:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788940626.611884:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944851456 00000100:00100000:3.0:1788940626.611888:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944851456 00000100:00100000:3.0:1788940626.611911:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788940626.611917:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944851456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.611949:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944851456:12345-0@lo:400:kworker.0 Request processed in 32us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940626.611956:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1788940626.612000:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940626.612022:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944850944:0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.612031:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944851456:0@lo:400:kworker.0 00010000:00080000:3.0:1788940626.612056:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf084de680 x1875839944851968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940626.612064:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf084de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944851968:0@lo:400:kworker.0 00000100:00100000:3.0:1788940626.612073:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944851328:0@lo:400:kworker.0 00010000:00080000:3.0:1788940626.612081:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf084df100 x1875839944851840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940626.612090:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf084df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944851840:0@lo:400:kworker.0 00010000:00010000:0.0:1788940627.229004:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940628.259938:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940629.154959:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944852352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788940629.155068:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940629.155912:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944852352 00000100:00100000:2.0:1788940629.155926:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944852352 00000100:00100000:2.0:1788940629.155994:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788940629.156006:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944852352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940629.156052:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788940629.156127:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944852352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940629.156136:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788940629.156217:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944852352:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788940629.277553:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940629.289606:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940629.289653:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940629.289691:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940629.289727:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940629.289759:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940629.289790:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940629.289821:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940629.289859:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921700096 00000100:00100000:0.0:1788940629.289873:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921700096 00000100:00100000:0.0:1788940629.289953:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921700224 00000100:00100000:0.0:1788940629.289958:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921700224 00000100:00100000:0.0:1788940629.289986:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 70 00000100:00100000:0.0:1788940629.289997:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2407:x1875839921700096:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940629.290096:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2407:x1875839921700096:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 99us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940629.290121:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 70 00000100:00100000:0.0:1788940629.290142:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 71 00000100:00100000:0.0:1788940629.290148:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2407:x1875839921700224:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940629.290178:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2407:x1875839921700224:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 30us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940629.290185:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 71 00000100:00100000:0.0:1788940629.290206:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921699456 00000100:00100000:0.0:1788940629.290210:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921699456 00000100:00100000:0.0:1788940629.290240:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 312 00000100:00100000:0.0:1788940629.290248:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921699456:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940629.291706:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921699584 00000100:00100000:1.0:1788940629.291721:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921699584 00000100:00100000:1.0:1788940629.291823:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921699840 00000100:00100000:1.0:1788940629.291827:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921699840 00000100:00100000:1.0:1788940629.291845:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921699712 00000100:00100000:1.0:1788940629.291849:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921699712 00000100:00100000:1.0:1788940629.291864:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921699968 00000100:00100000:1.0:1788940629.291867:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921699968 00000100:00100000:1.0:1788940629.291893:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 168 00000100:00100000:1.0:1788940629.291903:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921699584:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940629.291982:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921699584:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 81us (2392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940629.291991:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 168 00000100:00100000:1.0:1788940629.292009:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 169 00000100:00100000:1.0:1788940629.292016:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2407:x1875839921699840:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940629.292040:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2407:x1875839921699840:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 25us (2388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940629.292046:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 169 00000100:00100000:1.0:1788940629.292057:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 170 00000100:00100000:1.0:1788940629.292063:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921699712:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940629.292084:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921699712:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 23us (2326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940629.292089:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 170 00000100:00100000:1.0:1788940629.292099:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 171 00000100:00100000:1.0:1788940629.292104:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2407:x1875839921699968:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940629.292127:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2407:x1875839921699968:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 22us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940629.292149:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 171 00000100:00080000:1.0:1788940629.292859:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940629.292865:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940629.292869:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940629.292872:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940629.292953:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921699456:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 2699us (3219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940629.292964:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 312 00000100:00100000:2.0:1788940629.664029:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944852480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788940629.664131:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940629.664196:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944852480 00000100:00100000:1.0:1788940629.664213:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944852480 00000100:00100000:1.0:1788940629.664324:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788940629.664388:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944852480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788940629.664427:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940629.664518:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944852480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 185us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940629.664525:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1788940629.664620:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788940629.664642:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f70a80 x1875839944852480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940629.664672:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944852480:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1788940629.665924:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3fe11818-a425-4818-b40c-4d2e4f9916d8 00000100:00100000:1.0:1788940629.674024:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944852608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940629.674125:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:1.0:1788940629.674245:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3fe11818-a425-4818-b40c-4d2e4f9916d8 00000001:00100000:1.0:1788940629.674315:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3fe11818-a425-4818-b40c-4d2e4f9916d8 00000100:00100000:3.0:1788940629.677405:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944852608 00000100:00100000:3.0:1788940629.677422:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944852608 00000100:00100000:3.0:1788940629.677495:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788940629.677505:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944852608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940629.677533:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940629.677618:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944852608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (3497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940629.677625:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788940629.756085:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788940629.756171:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d020c8f100 x1875839944852608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940629.756199:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944852608:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788940629.759122:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3fe11818-a425-4818-b40c-4d2e4f9916d8 00010000:00010000:0.0:1788940630.305036:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940630.684065:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940630.684097:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944852736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940630.684189:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940630.684863:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944852736 00000100:00100000:2.0:1788940630.684880:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944852736 00000100:00100000:2.0:1788940630.684958:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788940630.684972:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944852736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940630.685027:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940630.685121:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944852736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940630.685129:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788940630.691820:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944852736:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788940631.325135:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940631.708550:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940631.708575:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944852864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940631.708649:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940631.723436:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944852864 00000100:00100000:3.0:1788940631.723453:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944852864 00000100:00100000:3.0:1788940631.723584:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788940631.723597:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944852864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940631.723635:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940631.723736:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944852864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (15086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940631.723744:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788940631.723849:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944852992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940631.723890:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788940631.723941:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d020c8c380 x1875839944852864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940631.723960:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944852864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940631.723989:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944852992 00000100:00100000:3.0:1788940631.723993:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944852992 00000100:00100000:3.0:1788940631.724018:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788940631.724024:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944852992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788940631.724035:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940631.724064:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944852992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940631.724070:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1788940631.724106:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0359d5180 x1875839944852992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940631.724118:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944852992:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788940631.724436:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940631.724553:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944853248:0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.724590:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940631.724610:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944853760:0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.724644:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940631.724663:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839944854272:0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.724683:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940631.724703:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788940631.724709:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944853120:0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.724744:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940631.724779:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944853632:0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.724804:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940631.724824:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944854144:0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.724846:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940631.724872:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944853504:0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.724893:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940631.724910:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944854016:0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.724929:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940631.724944:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788940631.724948:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944853376:0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.724966:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940631.724980:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839944853888:0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.724997:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940631.725011:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944854400:0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.725029:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940631.725050:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944853248 00000100:00100000:1.0:1788940631.725054:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944853248 00000100:00100000:1.0:1788940631.725080:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944853760 00000100:00100000:1.0:1788940631.725095:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944853760 00000100:00100000:1.0:1788940631.725126:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944854272 00000100:00100000:1.0:1788940631.725129:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944854272 00000100:00100000:1.0:1788940631.725141:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944853504 00000100:00100000:1.0:1788940631.725144:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944853504 00000100:00100000:1.0:1788940631.725154:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944853888 00000100:00100000:1.0:1788940631.725157:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944853888 00000100:00100000:1.0:1788940631.725167:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944854400 00000100:00100000:1.0:1788940631.725170:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944854400 00000100:00100000:1.0:1788940631.725183:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788940631.725189:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944853248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.725249:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944853248:12345-0@lo:400:kworker.0 Request processed in 60us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940631.725276:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788940631.725292:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788940631.725299:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944853760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.725328:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944853760:12345-0@lo:400:kworker.0 Request processed in 30us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940631.725774:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788940631.725791:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788940631.725798:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839944854272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.725832:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839944854272:12345-0@lo:400:kworker.0 Request processed in 35us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940631.725838:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788940631.725849:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788940631.725855:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944853504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.725891:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944853504:12345-0@lo:400:kworker.0 Request processed in 36us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940631.725908:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788940631.725931:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788940631.725937:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839944853888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.725967:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839944853888:12345-0@lo:400:kworker.0 Request processed in 31us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940631.725973:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788940631.725984:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788940631.725990:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944854400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.726020:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944854400:12345-0@lo:400:kworker.0 Request processed in 31us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940631.726026:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788940631.726055:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944853120 00000100:00100000:1.0:1788940631.726060:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944853120 00000100:00100000:1.0:1788940631.726093:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788940631.726099:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944853120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.726128:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944853120:12345-0@lo:400:kworker.0 Request processed in 29us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940631.726134:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788940631.726163:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944854144 00000100:00100000:1.0:1788940631.726167:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944854144 00000100:00100000:1.0:1788940631.726192:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944854016 00000100:00100000:3.0:1788940631.726380:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944853632 00000100:00100000:3.0:1788940631.726385:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944853632 00000100:00100000:3.0:1788940631.726411:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944853376 00000100:00100000:3.0:1788940631.726420:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944853376 00000100:00100000:3.0:1788940631.726435:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788940631.726440:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944853632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940631.726474:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944853632:12345-0@lo:400:kworker.0 Request processed in 35us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940631.726479:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788940631.726494:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788940631.726499:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944853376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940631.726536:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944853376:12345-0@lo:400:kworker.0 Request processed in 37us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940631.726541:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788940631.726592:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788940631.726600:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944854144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940631.726628:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944854144:12345-0@lo:400:kworker.0 Request processed in 30us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940631.726634:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1788940631.726655:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940631.726659:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788940631.726661:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940631.726703:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944853376:0@lo:400:kworker.0 00010000:00080000:3.0:1788940631.726719:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0042b0380 x1875839944853888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940631.726729:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839944853888:0@lo:400:kworker.0 00010000:00080000:3.0:1788940631.726739:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0042b0a80 x1875839944854400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940631.726775:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944854400:0@lo:400:kworker.0 00000100:00100000:3.0:1788940631.726790:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944853504:0@lo:400:kworker.0 00000100:00100000:3.0:1788940631.726826:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944853120:0@lo:400:kworker.0 00000100:00100000:3.0:1788940631.726837:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944853632:0@lo:400:kworker.0 00010000:00080000:3.0:1788940631.726848:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0042b1880 x1875839944854144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940631.726855:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944854144:0@lo:400:kworker.0 00000100:00100000:3.0:1788940631.726865:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944853248:0@lo:400:kworker.0 00000100:00100000:3.0:1788940631.726876:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944853760:0@lo:400:kworker.0 00000100:00100000:3.0:1788940631.726885:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839944854272:0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.727141:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944854016 00000100:00100000:1.0:1788940631.727184:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788940631.727190:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944854016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.727324:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944854016:12345-0@lo:400:kworker.0 Request processed in 132us (2392us total) trans 0 rc 0/0 00010000:00080000:2.0:1788940631.727500:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0042b3800 x1875839944854016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940631.727509:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944854016:0@lo:400:kworker.0 00000100:00100000:1.0:1788940631.727591:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1788940631.727986:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788940632.347515:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788940632.653239:0:12198:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788940633.371505:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940634.268514:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940634.268547:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf084de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944854528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940634.268979:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940634.269047:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944854528 00000100:00100000:3.0:1788940634.269055:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944854528 00000100:00100000:3.0:1788940634.269099:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788940634.269109:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944854528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788940634.269141:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788940634.269189:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944854528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940634.269209:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788940634.269292:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf084de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944854528:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788940634.396402:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940634.405969:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940634.406044:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940634.406076:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940634.406095:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940634.406112:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940634.406128:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940634.406166:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940634.406193:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921700608 00000100:00100000:1.0:1788940634.406203:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921700608 00000100:00100000:1.0:1788940634.406275:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921700864 00000100:00100000:1.0:1788940634.406279:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921700864 00000100:00100000:1.0:1788940634.406294:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921700480 00000100:00100000:1.0:1788940634.406296:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921700480 00000100:00100000:1.0:1788940634.406308:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921700736 00000100:00100000:1.0:1788940634.406311:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921700736 00000100:00100000:1.0:1788940634.406327:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 178 00000100:00100000:1.0:1788940634.406336:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921700608:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940634.406409:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921700608:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 74us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940634.406418:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 178 00000100:00100000:1.0:1788940634.406434:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 179 00000100:00100000:1.0:1788940634.406440:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921700864:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940634.406463:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921700864:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 23us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940634.406478:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 179 00000100:00100000:1.0:1788940634.406490:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 180 00000100:00100000:1.0:1788940634.406496:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921700480:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940634.406521:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921700480:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 25us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940634.406526:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 180 00000100:00100000:1.0:1788940634.406537:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 181 00000100:00100000:1.0:1788940634.406543:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921700736:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940634.406565:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921700736:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 22us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940634.406570:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 181 00000100:00100000:1.0:1788940634.406588:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921701120 00000100:00100000:1.0:1788940634.406592:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921701120 00000100:00100000:1.0:1788940634.406628:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921700992 00000100:00100000:1.0:1788940634.406631:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921700992 00000100:00100000:1.0:1788940634.406652:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 74 00000100:00100000:1.0:1788940634.406659:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921701120:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940634.406686:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921701120:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 29us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940634.406692:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 74 00000100:00100000:1.0:1788940634.406703:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 75 00000100:00100000:1.0:1788940634.406709:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921700992:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940634.406730:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921700992:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 21us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940634.406812:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 75 00000100:00080000:1.0:1788940634.406840:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940634.406844:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940634.406846:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940634.406848:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788940634.412697:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921700352 00000100:00100000:0.0:1788940634.412713:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921700352 00000100:00100000:0.0:1788940634.412798:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 314 00000100:00100000:0.0:1788940634.412821:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921700352:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940634.416897:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921700352:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 4069us (10914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940634.416927:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 314 00000100:00100000:0.0:1788940634.779598:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940634.779625:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944854656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940634.779711:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940634.780214:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944854656 00000100:00100000:2.0:1788940634.780241:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944854656 00000100:00100000:2.0:1788940634.780339:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788940634.780349:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944854656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788940634.780383:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940634.780451:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944854656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940634.780458:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:2.0:1788940634.780545:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f70a80 x1875839944854656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940634.780566:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944854656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940634.780970:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940634.781000:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf084de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944854784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940634.781043:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940634.781084:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944854784 00000100:00100000:3.0:1788940634.781106:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944854784 00000100:00100000:3.0:1788940634.781139:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788940634.781146:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944854784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940634.781158:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940634.781190:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944854784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940634.781197:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1788940634.781225:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf084de680 x1875839944854784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940634.781238:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf084de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944854784:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788940634.783914:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788940635.423333:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940635.806511:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944854912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788940635.806597:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940635.806685:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944854912 00000100:00100000:0.0:1788940635.806693:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944854912 00000100:00100000:0.0:1788940635.806752:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788940635.806761:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944854912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788940635.806795:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788940635.806871:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944854912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940635.806878:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788940635.806924:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944854912:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788940636.445505:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940636.828370:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940636.828397:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944855040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940636.828486:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940636.828561:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944855040 00000100:00100000:2.0:1788940636.828570:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944855040 00000100:00100000:2.0:1788940636.828634:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788940636.828724:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944855040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940636.828758:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940636.828825:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944855040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940636.828832:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788940636.828856:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788940636.828887:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07f70a80 x1875839944855040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940652 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940636.828908:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944855040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940636.829904:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944855552:0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.829978:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940636.830011:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839944856064:0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.830036:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940636.830054:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944856576:0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.830073:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940636.830102:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788940636.830107:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944855424:0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.830128:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940636.830143:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944855936:0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.830158:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940636.830171:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944856448:0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.830186:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940636.830219:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944855168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940636.830239:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940636.830278:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944855680:0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.830300:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940636.830311:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944856192:0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.830330:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940636.830344:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944856704:0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.830358:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940636.830372:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788940636.830377:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944855296:0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.830401:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940636.830420:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944855808:0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.830440:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940636.830457:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944856320:0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.830476:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940636.830504:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944856064 00000100:00100000:3.0:1788940636.830510:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944856064 00000100:00100000:3.0:1788940636.830547:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944856576 00000100:00100000:3.0:1788940636.830557:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944856576 00000100:00100000:3.0:1788940636.830578:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944855424 00000100:00100000:3.0:1788940636.830580:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944855424 00000100:00100000:3.0:1788940636.830590:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944855936 00000100:00100000:3.0:1788940636.830592:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944855936 00000100:00100000:3.0:1788940636.830603:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944856448 00000100:00100000:3.0:1788940636.830605:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944856448 00000100:00100000:3.0:1788940636.830615:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944855680 00000100:00100000:3.0:1788940636.830617:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944855680 00000100:00100000:3.0:1788940636.830631:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788940636.830651:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839944856064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.830702:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839944856064:12345-0@lo:400:kworker.0 Request processed in 64us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.830719:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788940636.830737:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788940636.830743:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944856576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.830771:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944856576:12345-0@lo:400:kworker.0 Request processed in 28us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.830776:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788940636.830788:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788940636.830794:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944855424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.830822:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944855424:12345-0@lo:400:kworker.0 Request processed in 29us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.830827:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788940636.830838:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788940636.830843:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944855936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.830866:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944855936:12345-0@lo:400:kworker.0 Request processed in 23us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.830880:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788940636.830891:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788940636.830896:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944856448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.830921:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944856448:12345-0@lo:400:kworker.0 Request processed in 25us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.830926:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788940636.830937:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788940636.830942:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944855680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.830972:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944855680:12345-0@lo:400:kworker.0 Request processed in 30us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.830977:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788940636.831009:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944855168 00000100:00100000:3.0:1788940636.831013:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944855168 00000100:00100000:3.0:1788940636.831040:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788940636.831046:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944855168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788940636.831061:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940636.831091:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944855168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.831096:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788940636.831112:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944856192 00000100:00100000:3.0:1788940636.831116:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944856192 00000100:00100000:3.0:1788940636.831138:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944856704 00000100:00100000:3.0:1788940636.831141:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944856704 00000100:00100000:3.0:1788940636.831150:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944856320 00000100:00100000:3.0:1788940636.831153:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944856320 00000100:00100000:3.0:1788940636.831162:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788940636.831167:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944856192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.831200:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944856192:12345-0@lo:400:kworker.0 Request processed in 33us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.831206:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788940636.831216:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788940636.831220:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944856704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.831238:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944856704:12345-0@lo:400:kworker.0 Request processed in 19us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.831243:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788940636.831251:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788940636.831275:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944856320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.831297:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944856320:12345-0@lo:400:kworker.0 Request processed in 42us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.831302:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788940636.831319:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944855296 00000100:00100000:3.0:1788940636.831322:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944855296 00000100:00100000:3.0:1788940636.831341:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788940636.831346:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944855296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.831369:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944855296:12345-0@lo:400:kworker.0 Request processed in 22us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.831373:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788940636.831394:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944855552 00000100:00100000:3.0:1788940636.831397:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944855552 00000100:00100000:3.0:1788940636.831415:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944855808 00000100:00100000:3.0:1788940636.831417:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944855808 00000100:00100000:3.0:1788940636.831427:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788940636.831432:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944855552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.831467:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944855552:12345-0@lo:400:kworker.0 Request processed in 35us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.831473:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788940636.831484:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788940636.831490:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944855808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.831512:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944855808:12345-0@lo:400:kworker.0 Request processed in 23us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940636.831517:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788940636.831547:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944855424:0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.831557:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944855936:0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.831565:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944856448:0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.831573:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944855552:0@lo:400:kworker.0 00010000:00080000:3.0:1788940636.831584:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03588f800 x1875839944856064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940636.831592:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839944856064:0@lo:400:kworker.0 00010000:00080000:3.0:1788940636.831601:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03588d500 x1875839944856576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940636.831608:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944856576:0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.831640:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944855296:0@lo:400:kworker.0 00000100:00100000:3.0:1788940636.831648:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944855808:0@lo:400:kworker.0 00010000:00080000:3.0:1788940636.831657:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03588dc00 x1875839944856320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940636.831672:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944856320:0@lo:400:kworker.0 00010000:00080000:3.0:1788940636.831683:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ff2680 x1875839944855168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940652 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940636.831695:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944855168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940636.831705:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944855680:0@lo:400:kworker.0 00010000:00080000:3.0:1788940636.831727:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03588ed80 x1875839944856192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940636.831734:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944856192:0@lo:400:kworker.0 00010000:00080000:3.0:1788940636.831741:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03588c380 x1875839944856704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940636.831747:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944856704:0@lo:400:kworker.0 00000100:00080000:3.0:1788940636.831779:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940636.831782:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940636.831784:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940636.831787:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788940637.467586:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940638.496461:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940639.387887:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940639.387911:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944856832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788940639.388001:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940639.391762:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944856832 00000100:00100000:3.0:1788940639.391777:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944856832 00000100:00100000:3.0:1788940639.391900:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788940639.391911:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944856832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788940639.391954:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788940639.392046:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944856832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (4044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940639.392083:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788940639.392191:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944856832:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788940639.515492:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940639.528000:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940639.528043:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940639.528077:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940639.528119:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940639.528136:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940639.528152:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940639.528173:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940639.528398:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921701888 00000100:00100000:2.0:1788940639.528410:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921701888 00000100:00100000:2.0:1788940639.528467:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921702016 00000100:00100000:2.0:1788940639.528471:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921702016 00000100:00100000:2.0:1788940639.528496:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 79 00000100:00100000:2.0:1788940639.528507:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921701888:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940639.528579:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921701888:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 73us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940639.528605:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 79 00000100:00100000:2.0:1788940639.528625:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 80 00000100:00100000:2.0:1788940639.528631:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921702016:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940639.528658:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921702016:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940639.528663:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 80 00000100:00100000:0.0:1788940639.528739:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921701376 00000100:00100000:0.0:1788940639.528745:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921701376 00000100:00100000:0.0:1788940639.528783:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921701632 00000100:00100000:0.0:1788940639.528787:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921701632 00000100:00100000:0.0:1788940639.528801:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921701504 00000100:00100000:0.0:1788940639.528803:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921701504 00000100:00100000:0.0:1788940639.528815:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921701760 00000100:00100000:0.0:1788940639.528817:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921701760 00000100:00100000:0.0:1788940639.528832:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 188 00000100:00100000:0.0:1788940639.528839:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921701376:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940639.528879:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921701376:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 40us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940639.528886:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 188 00000100:00100000:0.0:1788940639.528900:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 189 00000100:00100000:0.0:1788940639.528906:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921701632:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940639.528928:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921701632:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 22us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940639.528934:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 189 00000100:00100000:0.0:1788940639.528946:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 190 00000100:00100000:0.0:1788940639.528952:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921701504:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940639.528991:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921701504:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 39us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940639.528997:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 190 00000100:00100000:0.0:1788940639.529008:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 191 00000100:00100000:0.0:1788940639.529013:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921701760:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940639.529035:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921701760:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 21us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940639.529040:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 191 00000100:00100000:0.0:1788940639.529058:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921701248 00000100:00100000:0.0:1788940639.529061:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921701248 00000100:00100000:0.0:1788940639.529384:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 316 00000100:00100000:0.0:1788940639.529393:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921701248:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940639.529421:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921701248:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 29us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940639.529435:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 316 00000100:00080000:1.0:1788940639.529925:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940639.529930:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940639.529933:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940639.529936:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940639.902315:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940639.902337:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944856960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940639.902472:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940639.902537:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944856960 00000100:00100000:1.0:1788940639.902544:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944856960 00000100:00100000:1.0:1788940639.902614:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788940639.902624:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944856960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788940639.902664:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940639.902720:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944856960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940639.902727:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1788940639.902749:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940639.902778:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d037852d80 x1875839944856960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940639.902797:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944856960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940639.907678:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940639.907716:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944857088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940639.907790:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940639.907883:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944857088 00000100:00100000:2.0:1788940639.907891:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944857088 00000100:00100000:2.0:1788940639.907956:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788940639.907965:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944857088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940639.907986:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940639.908076:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944857088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940639.908093:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1788940639.909903:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788940639.909951:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03588ea00 x1875839944857088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940639.909973:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944857088:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788940640.542935:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940640.924790:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944857216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940640.924896:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940640.925056:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944857216 00000100:00100000:2.0:1788940640.925065:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944857216 00000100:00100000:2.0:1788940640.925127:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788940640.925138:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944857216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940640.925200:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940640.926688:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944857216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1537us (1777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940640.926700:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788940640.927212:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944857216:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788940641.564344:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940641.947520:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940641.947544:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944857344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940641.947730:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940641.947825:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944857344 00000100:00100000:1.0:1788940641.947835:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944857344 00000100:00100000:1.0:1788940641.948760:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788940641.948773:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944857344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788940641.948805:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940641.948869:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944857344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940641.948877:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1788940641.948929:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d037850000 x1875839944857344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940641.948949:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944857344:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788940641.950893:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940641.951035:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944857472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940641.951095:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940641.951195:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944857472 00000100:00100000:0.0:1788940641.951204:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944857472 00000100:00100000:0.0:1788940641.951289:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788940641.951298:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944857472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940641.951321:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940641.951362:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944857472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940641.951369:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1788940641.951436:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788940641.951464:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d020c8c380 x1875839944857472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940641.951481:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944857472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940641.952297:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944857728:0@lo:400:kworker.0 00000100:00100000:0.0:1788940641.952335:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940641.952357:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944858240:0@lo:400:kworker.0 00000100:00100000:0.0:1788940641.952378:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940641.952394:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944858752:0@lo:400:kworker.0 00000100:00100000:0.0:1788940641.952415:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940641.952432:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788940641.952437:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944857856:0@lo:400:kworker.0 00000100:00100000:0.0:1788940641.952461:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940641.952476:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944858368:0@lo:400:kworker.0 00000100:00100000:0.0:1788940641.952496:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940641.952510:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944858880:0@lo:400:kworker.0 00000100:00100000:0.0:1788940641.952528:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940641.952549:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944857728 00000100:00100000:0.0:1788940641.952554:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944857728 00000100:00100000:0.0:1788940641.952587:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944858240 00000100:00100000:0.0:1788940641.952590:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944858240 00000100:00100000:0.0:1788940641.952607:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944858752 00000100:00100000:0.0:1788940641.952610:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944858752 00000100:00100000:0.0:1788940641.952621:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944858368 00000100:00100000:0.0:1788940641.952623:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944858368 00000100:00100000:0.0:1788940641.952633:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944858880 00000100:00100000:0.0:1788940641.952635:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944858880 00000100:00100000:0.0:1788940641.952647:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788940641.952654:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944857728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940641.952706:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944857728:12345-0@lo:400:kworker.0 Request processed in 52us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940641.952714:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788940641.952728:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788940641.952734:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944858240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940641.952759:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944858240:12345-0@lo:400:kworker.0 Request processed in 26us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940641.952765:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788940641.952776:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788940641.952782:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944858752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940641.952806:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944858752:12345-0@lo:400:kworker.0 Request processed in 24us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940641.952811:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788940641.952821:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788940641.952826:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944858368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940641.952853:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944858368:12345-0@lo:400:kworker.0 Request processed in 27us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940641.952868:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788940641.952880:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788940641.952885:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944858880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940641.952914:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944858880:12345-0@lo:400:kworker.0 Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940641.952921:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00010000:00080000:0.0:1788940641.952949:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06ec7800 x1875839944858368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940641.952959:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944858368:0@lo:400:kworker.0 00010000:00080000:0.0:1788940641.952969:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06ec5180 x1875839944858880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940641.952976:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944858880:0@lo:400:kworker.0 00000100:00100000:0.0:1788940641.952984:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944857728:0@lo:400:kworker.0 00000100:00100000:0.0:1788940641.952993:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944858240:0@lo:400:kworker.0 00000100:00100000:0.0:1788940641.953001:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944858752:0@lo:400:kworker.0 00000100:00100000:3.0:1788940641.953328:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944857856 00000100:00100000:3.0:1788940641.953334:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944857856 00000100:00100000:3.0:1788940641.953359:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788940641.953366:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944857856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940641.953407:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944857856:12345-0@lo:400:kworker.0 Request processed in 42us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940641.953413:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788940641.953450:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944857856:0@lo:400:kworker.0 00000100:00080000:1.0:1788940641.958055:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940641.958068:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940641.958093:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944857984:0@lo:400:kworker.0 00000100:00100000:1.0:1788940641.958165:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940641.958324:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944857984 00000100:00100000:0.0:1788940641.958334:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944857984 00000100:00100000:0.0:1788940641.958389:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788940641.958399:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944857984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940641.958453:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944857984:12345-0@lo:400:kworker.0 Request processed in 56us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940641.958460:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788940641.958559:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944857984:0@lo:400:kworker.0 00000100:00100000:1.0:1788940641.958568:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944858496:0@lo:400:kworker.0 00000100:00100000:1.0:1788940641.958595:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940641.958681:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788940641.958689:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944857600:0@lo:400:kworker.0 00000100:00100000:1.0:1788940641.958719:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940641.958743:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944858112:0@lo:400:kworker.0 00000100:00100000:1.0:1788940641.958767:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940641.958786:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944858624:0@lo:400:kworker.0 00000100:00100000:1.0:1788940641.958808:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940641.960829:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944857600 00000100:00100000:1.0:1788940641.960843:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944857600 00000100:00100000:1.0:1788940641.960893:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788940641.960903:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944857600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940641.960972:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944857600:12345-0@lo:400:kworker.0 Request processed in 69us (2251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940641.960979:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788940641.961019:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944858112 00000100:00100000:1.0:1788940641.961023:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944858112 00000100:00100000:1.0:1788940641.961049:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788940641.961054:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944858112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940641.961087:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944858112:12345-0@lo:400:kworker.0 Request processed in 33us (2320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940641.961093:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788940641.961130:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944857600:0@lo:400:kworker.0 00000100:00100000:1.0:1788940641.961142:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944858112:0@lo:400:kworker.0 00000100:00100000:0.0:1788940641.963394:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944858496 00000100:00100000:0.0:1788940641.963407:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944858496 00000100:00100000:0.0:1788940641.963524:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944858624 00000100:00100000:0.0:1788940641.963529:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944858624 00000100:00100000:3.0:1788940641.963584:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788940641.963595:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944858496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940641.963688:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944858496:12345-0@lo:400:kworker.0 Request processed in 97us (5092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940641.963695:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1788940641.963741:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06ec5c00 x1875839944858496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940641.963770:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944858496:0@lo:400:kworker.0 00000100:00080000:1.0:1788940641.966705:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940641.967823:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788940641.967837:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944858624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940641.967929:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944858624:12345-0@lo:400:kworker.0 Request processed in 96us (9119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940641.967937:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1788940641.967983:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06ec4e00 x1875839944858624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940641.967998:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944858624:0@lo:400:kworker.0 00010000:00010000:3.0:1788940642.587590:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940643.612476:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788940643.691753:0:12515:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788940643.692929:0:12515:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788940644.514617:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940644.514649:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944859008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940644.514737:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940644.514812:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944859008 00000100:00100000:3.0:1788940644.514819:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944859008 00000100:00100000:3.0:1788940644.514862:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788940644.514870:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944859008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788940644.514908:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788940644.514980:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944859008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940644.514987:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788940644.515032:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944859008:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788940644.635397:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940644.646551:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940644.646625:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940644.646665:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940644.646687:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940644.646769:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940644.646800:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921702400 00000100:00100000:1.0:1788940644.646810:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921702400 00000100:00100000:1.0:1788940644.646860:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921702656 00000100:00100000:1.0:1788940644.646863:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921702656 00000100:00100000:1.0:1788940644.646876:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921702272 00000100:00100000:1.0:1788940644.646878:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921702272 00000100:00100000:1.0:1788940644.646888:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921702528 00000100:00100000:1.0:1788940644.646889:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921702528 00000100:00100000:1.0:1788940644.646901:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 198 00000100:00100000:1.0:1788940644.646910:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921702400:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940644.646975:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921702400:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 66us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940644.646982:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 198 00000100:00100000:1.0:1788940644.647007:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 199 00000100:00100000:1.0:1788940644.647013:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921702656:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940644.647041:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921702656:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 29us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940644.647048:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 199 00000100:00100000:1.0:1788940644.647059:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 200 00000100:00100000:1.0:1788940644.647065:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+6:2406:x1875839921702272:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940644.647087:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+6:2406:x1875839921702272:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 23us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940644.647093:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 200 00000100:00100000:1.0:1788940644.647104:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 201 00000100:00100000:1.0:1788940644.647111:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2406:x1875839921702528:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940644.647132:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2406:x1875839921702528:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 22us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940644.647138:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 201 00000100:00080000:1.0:1788940644.647164:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940644.647168:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788940644.647654:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921702144 00000100:00100000:3.0:1788940644.647661:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921702144 00000100:00100000:1.0:1788940644.648961:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 318 00000100:00100000:1.0:1788940644.648986:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921702144:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940644.649073:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921702144:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 99us (2531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940644.649080:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 318 00000100:00100000:1.0:1788940644.655730:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940644.655764:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940644.655837:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921702784 00000100:00100000:2.0:1788940644.655847:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921702784 00000100:00100000:2.0:1788940644.655904:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921702912 00000100:00100000:2.0:1788940644.655908:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921702912 00000100:00100000:2.0:1788940644.655927:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:2.0:1788940644.655945:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08549c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2403:x1875839921702784:12345-192.168.202.25@tcp:9:kworker.0 00000020:00000080:2.0:1788940644.655973:0:8438:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd251 00000100:00080000:2.0:1788940644.655981:0:8438:0:(import.c:65:import_set_state_nolock()) ffff91d03593a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788940644.656018:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788940644.656209:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08549c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+2:2403:x1875839921702784:12345-192.168.202.25@tcp:9:kworker.0 Request processed in 273us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940644.656217:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:2.0:1788940644.656232:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:2.0:1788940644.656238:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2403:x1875839921702912:12345-192.168.202.25@tcp:9:kworker.0 00000020:00000080:2.0:1788940644.656248:0:8438:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd258 00000100:00080000:2.0:1788940644.656275:0:8438:0:(import.c:65:import_set_state_nolock()) ffff91d020c90000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788940644.656295:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788940644.656350:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08549180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+2:2403:x1875839921702912:12345-192.168.202.25@tcp:9:kworker.0 Request processed in 112us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940644.656356:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00010000:00010000:2.0:1788940644.656378:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788940644.657313:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940644.657319:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788940644.659195:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940645.019809:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940645.019832:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944859136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940645.019964:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940645.021773:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944859136 00000100:00100000:3.0:1788940645.021788:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944859136 00000100:00100000:3.0:1788940645.021877:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788940645.021889:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944859136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940645.021930:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940645.022013:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944859136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (2048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.022021:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:3.0:1788940645.022088:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03588ea00 x1875839944859136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940645.022109:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944859136:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788940645.022397:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940645.030617:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944859264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940645.030704:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940645.047292:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944859264 00000100:00100000:2.0:1788940645.047307:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944859264 00000100:00100000:2.0:1788940645.047377:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788940645.047387:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944859264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788940645.047412:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940645.047491:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944859264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (16787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940645.047498:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1788940645.047560:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03588ed80 x1875839944859264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940645.047581:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944859264:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788940645.047743:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788940645.659470:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940646.047032:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944859392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940646.047098:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940646.047169:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944859392 00000100:00100000:1.0:1788940646.047177:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944859392 00000100:00100000:1.0:1788940646.047222:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788940646.047231:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0854b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944859392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788940646.047293:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788940646.047345:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0854b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944859392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940646.047353:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788940646.047397:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944859392:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1788940646.507609:0:12612:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788940646.509193:0:12612:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788940646.683599:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940647.067480:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944859520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940647.067565:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940647.067652:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944859520 00000100:00100000:1.0:1788940647.067660:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944859520 00000100:00100000:1.0:1788940647.067720:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788940647.067729:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0854ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944859520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940647.067761:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940647.067808:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0854ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944859520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940647.067816:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788940647.067839:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788940647.067871:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08549f80 x1875839944859520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940647.067906:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944859520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940647.068249:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944859648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940647.068319:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940647.068538:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944859648 00000100:00100000:3.0:1788940647.068544:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944859648 00000100:00100000:3.0:1788940647.068583:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788940647.068591:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944859648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788940647.068605:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940647.068652:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944859648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940647.068659:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1788940647.068753:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788940647.068776:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06ec5c00 x1875839944859648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940647.068790:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944859648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788940647.069045:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0854bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944860032:0@lo:400:kworker.0 00000100:00100000:1.0:1788940647.069077:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940647.069097:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0854aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944860544:0@lo:400:kworker.0 00000100:00100000:1.0:1788940647.069122:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940647.069139:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0854a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944861056:0@lo:400:kworker.0 00000100:00100000:1.0:1788940647.069177:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940647.069199:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788940647.069204:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08549500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944860160:0@lo:400:kworker.0 00000100:00100000:1.0:1788940647.069226:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940647.069242:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944860672:0@lo:400:kworker.0 00000100:00100000:1.0:1788940647.069297:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940647.069324:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944860032 00000100:00100000:1.0:1788940647.069329:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944860032 00000100:00100000:1.0:1788940647.069360:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788940647.069367:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0854a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944860032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940647.069407:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0854a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944860032:12345-0@lo:400:kworker.0 Request processed in 41us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940647.069414:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788940647.069433:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944860544 00000100:00100000:1.0:1788940647.069436:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944860544 00000100:00100000:1.0:1788940647.069463:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944861056 00000100:00100000:1.0:1788940647.069465:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944861056 00000100:00100000:1.0:1788940647.069480:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944860160 00000100:00100000:1.0:1788940647.069482:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944860160 00000100:00100000:1.0:1788940647.069505:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788940647.069512:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0854b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944860544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.069643:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944859776:0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.069675:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940647.069700:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08548380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944860288:0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.069722:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940647.069740:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944860800:0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.069759:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940647.069786:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788940647.069792:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944859904:0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.069813:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940647.069823:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0854b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944860416:0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.069840:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940647.069850:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944860928:0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.069866:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940647.069884:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944860672 00000100:00100000:2.0:1788940647.069887:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944860672 00000100:00100000:2.0:1788940647.069912:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944860800 00000100:00100000:2.0:1788940647.069914:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944860800 00000100:00100000:2.0:1788940647.069933:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788940647.069940:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944860672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.069971:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944860672:12345-0@lo:400:kworker.0 Request processed in 31us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940647.069977:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788940647.069991:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788940647.069997:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944860800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.070024:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944860800:12345-0@lo:400:kworker.0 Request processed in 27us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940647.070030:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788940647.070046:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944859904 00000100:00100000:2.0:1788940647.070049:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944859904 00000100:00100000:2.0:1788940647.070061:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944860416 00000100:00100000:2.0:1788940647.070064:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944860416 00000100:00100000:2.0:1788940647.070073:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944860928 00000100:00100000:2.0:1788940647.070075:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944860928 00000100:00100000:2.0:1788940647.070087:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788940647.070101:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944861056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.070131:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944861056:12345-0@lo:400:kworker.0 Request processed in 31us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940647.070137:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788940647.070149:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788940647.070155:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944860160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.070180:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944860160:12345-0@lo:400:kworker.0 Request processed in 25us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940647.070186:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788940647.070197:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788940647.070203:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944859904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.070227:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944859904:12345-0@lo:400:kworker.0 Request processed in 25us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940647.070233:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788940647.070245:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788940647.070251:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944860416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.070298:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944860416:12345-0@lo:400:kworker.0 Request processed in 47us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940647.070304:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788940647.070316:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788940647.070322:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944860928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.070347:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944860928:12345-0@lo:400:kworker.0 Request processed in 26us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940647.070353:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788940647.070370:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944859776 00000100:00100000:2.0:1788940647.070379:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944859776 00000100:00100000:2.0:1788940647.070407:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788940647.070414:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944859776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.070442:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944859776:12345-0@lo:400:kworker.0 Request processed in 29us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940647.070448:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788940647.070474:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944860288 00000100:00100000:2.0:1788940647.070478:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944860288 00000100:00100000:2.0:1788940647.070498:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788940647.070504:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944860288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.070547:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944860288:12345-0@lo:400:kworker.0 Request processed in 43us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940647.070553:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1788940647.070581:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940647.070585:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940647.070587:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788940647.070624:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944859904:0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.070636:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0854b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944860416:0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.070644:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944860928:0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.070652:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944859776:0@lo:400:kworker.0 00000100:00100000:2.0:1788940647.070660:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08548380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944860288:0@lo:400:kworker.0 00010000:00080000:2.0:1788940647.070670:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08548e00 x1875839944860800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940647.070680:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944860800:0@lo:400:kworker.0 00000100:00100000:1.0:1788940647.071025:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0854b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944860544:12345-0@lo:400:kworker.0 Request processed in 1513us (1900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940647.071031:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788940647.071076:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08549500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944860160:0@lo:400:kworker.0 00010000:00080000:1.0:1788940647.071086:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08548a80 x1875839944860672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940647.071094:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944860672:0@lo:400:kworker.0 00000100:00100000:1.0:1788940647.071104:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0854bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944860032:0@lo:400:kworker.0 00010000:00080000:1.0:1788940647.071112:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf0854aa00 x1875839944860544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940647.071120:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0854aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944860544:0@lo:400:kworker.0 00010000:00080000:1.0:1788940647.071131:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf0854a680 x1875839944861056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940647.071138:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0854a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944861056:0@lo:400:kworker.0 00010000:00010000:3.0:1788940647.707460:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940648.732568:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788940649.142148:0:12709:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788940649.148332:0:12709:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788940649.629452:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944861184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788940649.629521:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940649.629655:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944861184 00000100:00100000:3.0:1788940649.629665:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944861184 00000100:00100000:3.0:1788940649.629760:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788940649.629770:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944861184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788940649.629803:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788940649.629868:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944861184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940649.629875:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788940649.629966:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944861184:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788940649.755483:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940649.768245:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940649.768314:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921703040 00000100:00100000:2.0:1788940649.768314:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940649.768323:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921703040 00000100:00100000:0.0:1788940649.768368:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921703168 00000100:00100000:0.0:1788940649.768375:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921703168 00000100:00100000:3.0:1788940649.768410:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 320 00000100:00100000:3.0:1788940649.768422:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2406:x1875839921703040:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940649.768433:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 208 00000100:00100000:0.0:1788940649.768445:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2406:x1875839921703168:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940649.768501:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2406:x1875839921703040:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 82us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940649.768506:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 320 00000100:00100000:0.0:1788940649.768665:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2406:x1875839921703168:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 221us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940649.768673:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 208 00000100:00080000:0.0:1788940649.769178:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940649.771898:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940649.771936:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940649.771964:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940649.772727:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921703424 00000100:00100000:1.0:1788940649.772739:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921703424 00000100:00100000:0.0:1788940649.772874:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921703552 00000100:00100000:0.0:1788940649.772878:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921703552 00000100:00100000:1.0:1788940649.772919:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921703296 00000100:00100000:0.0:1788940649.772930:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 209 00000100:00100000:1.0:1788940649.772933:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921703296 00000100:00100000:0.0:1788940649.772938:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0854a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921703424:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940649.773020:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0854a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921703424:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 82us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940649.773027:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 209 00000100:00100000:0.0:1788940649.773044:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 210 00000100:00100000:0.0:1788940649.773050:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0854bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921703552:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940649.773073:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0854bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921703552:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 23us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940649.773078:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 210 00000100:00100000:0.0:1788940649.773090:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 211 00000100:00100000:0.0:1788940649.773096:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0854aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921703296:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940649.773116:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0854aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921703296:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 21us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940649.773122:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 211 00000100:00080000:0.0:1788940649.773955:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788940649.773960:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940650.139394:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940650.139416:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944861312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788940650.139527:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940650.139662:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944861312 00000100:00100000:1.0:1788940650.139670:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944861312 00000100:00100000:1.0:1788940650.139737:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788940650.139761:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08549500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944861312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788940650.139789:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940650.139834:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08549500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944861312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940650.139841:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:1.0:1788940650.139882:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08548a80 x1875839944861312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940650.139914:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944861312:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788940650.140031:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940650.144555:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940650.144578:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944861440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940650.144658:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940650.144713:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944861440 00000100:00100000:2.0:1788940650.144721:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944861440 00000100:00100000:2.0:1788940650.144778:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788940650.144788:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944861440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940650.144811:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940650.144855:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944861440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940650.144862:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1788940650.144886:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788940650.145023:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08548e00 x1875839944861440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940650.145044:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944861440:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788940650.658046:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3fe11818-a425-4818-b40c-4d2e4f9916d8 00000020:00000080:2.0:1788940650.658054:0:8432:0:(genops.c:893:class_export_put()) final put ffff91d03593f000/3fe11818-a425-4818-b40c-4d2e4f9916d8 00000020:00000080:1.0:1788940650.658095:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03593f000/3fe11818-a425-4818-b40c-4d2e4f9916d8 for lustre-OST0000 00000020:00000080:1.0:1788940650.658149:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d03593a000 for lustre-OST0000 00000001:00100000:3.0:1788940650.658539:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3fe11818-a425-4818-b40c-4d2e4f9916d8 00000020:00000080:3.0:1788940650.658543:0:9517:0:(genops.c:893:class_export_put()) final put ffff91d020c96800/3fe11818-a425-4818-b40c-4d2e4f9916d8 00000020:00000080:2.0:1788940650.658603:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d020c96800/3fe11818-a425-4818-b40c-4d2e4f9916d8 for lustre-OST0001 00000020:00000080:2.0:1788940650.658637:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d020c90000 for lustre-OST0001 00010000:00010000:3.0:1788940650.791731:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940651.167017:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944861568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940651.167089:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940651.167193:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944861568 00000100:00100000:2.0:1788940651.167201:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944861568 00000100:00100000:2.0:1788940651.167252:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788940651.167283:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944861568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940651.167324:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940651.167404:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944861568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940651.167412:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788940651.167753:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944861568:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1788940651.219622:0:12807:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788940651.220345:0:12807:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788940651.803628:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940652.188661:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944861696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940652.188746:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940652.189219:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944861696 00000100:00100000:0.0:1788940652.189227:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944861696 00000100:00100000:0.0:1788940652.189359:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788940652.189370:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944861696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788940652.189411:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940652.189457:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944861696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940652.189463:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:0.0:1788940652.189500:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03475d180 x1875839944861696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940652.189518:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944861696:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788940652.190220:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940652.192438:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944861824:0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.192501:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940652.192535:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944862336:0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.192558:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940652.192587:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944862848:0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.192606:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940652.192626:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788940652.192631:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944861952:0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.192650:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940652.192664:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944862464:0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.192681:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940652.192693:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944862976:0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.192719:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940652.192749:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944861824 00000100:00100000:0.0:1788940652.192755:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944861824 00000100:00100000:0.0:1788940652.192795:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788940652.192803:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944861824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.192866:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944861824:12345-0@lo:400:kworker.0 Request processed in 64us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940652.192874:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788940652.192903:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944862336 00000100:00100000:0.0:1788940652.192906:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944862336 00000100:00100000:0.0:1788940652.192928:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788940652.192934:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944862336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.192962:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944862336:12345-0@lo:400:kworker.0 Request processed in 28us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940652.192967:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788940652.192981:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944862848 00000100:00100000:0.0:1788940652.192984:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944862848 00000100:00100000:0.0:1788940652.193012:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788940652.193017:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944862848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.193043:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944862848:12345-0@lo:400:kworker.0 Request processed in 25us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940652.193049:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788940652.193063:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944861952 00000100:00100000:0.0:1788940652.193066:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944861952 00000100:00100000:0.0:1788940652.193085:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944862464 00000100:00100000:0.0:1788940652.193087:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944862464 00000100:00100000:0.0:1788940652.193101:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944862976 00000100:00100000:0.0:1788940652.193103:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944862976 00000100:00100000:0.0:1788940652.193115:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788940652.193120:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944861952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.193159:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944861952:12345-0@lo:400:kworker.0 Request processed in 38us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940652.193172:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788940652.193184:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788940652.193190:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944862464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.193217:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944862464:12345-0@lo:400:kworker.0 Request processed in 29us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940652.193222:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788940652.193233:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788940652.193237:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944862976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.193277:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944862976:12345-0@lo:400:kworker.0 Request processed in 39us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940652.193283:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:0.0:1788940652.193320:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940652.193325:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940652.193335:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944862208:0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.193359:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940652.193373:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944862720:0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.193389:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940652.193403:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944863232:0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.193418:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940652.193432:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788940652.193437:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944862080:0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.193454:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940652.193469:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839944862592:0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.193485:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940652.193504:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944863104:0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.193521:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940652.193540:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944862208 00000100:00100000:0.0:1788940652.193543:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944862208 00000100:00100000:0.0:1788940652.193560:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944862592 00000100:00100000:0.0:1788940652.193563:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944862592 00000100:00100000:0.0:1788940652.193589:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944863104 00000100:00100000:0.0:1788940652.193592:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944863104 00000100:00100000:0.0:1788940652.193603:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788940652.193608:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944862208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.193637:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944862208:12345-0@lo:400:kworker.0 Request processed in 29us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940652.193643:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788940652.193653:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788940652.193658:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839944862592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.193678:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839944862592:12345-0@lo:400:kworker.0 Request processed in 21us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940652.193683:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788940652.193692:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788940652.193696:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944863104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.193716:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944863104:12345-0@lo:400:kworker.0 Request processed in 20us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940652.193721:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:0.0:1788940652.193737:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788940652.193759:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944861952:0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.193769:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944862464:0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.193786:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944862976:0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.193794:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944861824:0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.193801:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944862336:0@lo:400:kworker.0 00010000:00080000:0.0:1788940652.193811:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d034758000 x1875839944862848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940652.193822:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944862848:0@lo:400:kworker.0 00010000:00080000:0.0:1788940652.193865:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d034759880 x1875839944862592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940652.193873:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839944862592:0@lo:400:kworker.0 00010000:00080000:0.0:1788940652.193881:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03475b800 x1875839944863104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940652.193889:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944863104:0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.193896:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944862208:0@lo:400:kworker.0 00000100:00100000:1.0:1788940652.197070:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944862080 00000100:00100000:1.0:1788940652.197087:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944862080 00000100:00100000:1.0:1788940652.197159:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788940652.197169:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944862080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940652.197268:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944862080:12345-0@lo:400:kworker.0 Request processed in 88us (3800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940652.197275:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788940652.197335:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944862080:0@lo:400:kworker.0 00000100:00100000:1.0:1788940652.197732:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944862720 00000100:00100000:1.0:1788940652.197737:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944862720 00000100:00100000:1.0:1788940652.197773:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944863232 00000100:00100000:1.0:1788940652.197775:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944863232 00000100:00100000:1.0:1788940652.197789:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788940652.197794:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944862720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940652.197827:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944862720:12345-0@lo:400:kworker.0 Request processed in 33us (4436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940652.197831:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788940652.197839:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788940652.197843:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944863232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940652.197861:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944863232:12345-0@lo:400:kworker.0 Request processed in 18us (4442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940652.197864:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1788940652.197883:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940652.197886:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940652.197905:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03475a300 x1875839944862720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940652.197914:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944862720:0@lo:400:kworker.0 00010000:00080000:1.0:1788940652.197922:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03475ad80 x1875839944863232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940652.197929:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944863232:0@lo:400:kworker.0 00000100:00100000:0.0:1788940652.200548:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944863360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940652.200627:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940652.200688:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944863360 00000100:00100000:1.0:1788940652.200696:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944863360 00000100:00100000:1.0:1788940652.200738:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788940652.200744:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944863360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940652.200762:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940652.208858:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944863360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8105us (8222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940652.208880:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1788940652.216475:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08549f80 x1875839944863360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940652.216501:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944863360:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940652.831634:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940653.854583:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788940654.079396:0:12904:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788940654.079763:0:12904:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788940654.748572:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944863488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788940654.748640:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940654.748886:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944863488 00000100:00100000:1.0:1788940654.748893:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944863488 00000100:00100000:1.0:1788940654.748940:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788940654.748948:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944863488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788940654.748980:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788940654.749029:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944863488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940654.749035:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788940654.749225:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944863488:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788940654.887619:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940654.890806:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940654.890860:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940654.890891:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940654.890917:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940654.890954:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940654.890986:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921703808 00000100:00100000:2.0:1788940654.890997:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921703808 00000100:00100000:2.0:1788940654.891057:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921703936 00000100:00100000:2.0:1788940654.891060:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921703936 00000100:00100000:2.0:1788940654.891075:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921704192 00000100:00100000:2.0:1788940654.891078:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921704192 00000100:00100000:2.0:1788940654.891141:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921704064 00000100:00100000:2.0:1788940654.891144:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921704064 00000100:00100000:2.0:1788940654.891163:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 218 00000100:00100000:2.0:1788940654.891173:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0854b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:2406:x1875839921703808:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940654.891253:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0854b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:2406:x1875839921703808:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 81us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940654.891287:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 218 00000100:00100000:2.0:1788940654.891305:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 219 00000100:00100000:2.0:1788940654.891312:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921703936:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940654.891337:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921703936:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 26us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940654.891343:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 219 00000100:00100000:2.0:1788940654.891354:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 220 00000100:00100000:2.0:1788940654.891360:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921704192:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940654.891380:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921704192:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 21us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940654.891386:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 220 00000100:00100000:2.0:1788940654.891397:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 221 00000100:00100000:1.0:1788940654.891499:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921703680 00000100:00100000:1.0:1788940654.891504:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921703680 00000100:00100000:1.0:1788940654.891535:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 322 00000100:00100000:1.0:1788940654.891553:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921703680:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940654.891579:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921703680:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 38us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940654.891584:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 322 00000100:00100000:2.0:1788940654.894994:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2406:x1875839921704064:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940654.895806:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2406:x1875839921704064:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 4398us (4846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940654.895820:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 221 00000100:00080000:2.0:1788940654.895884:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940654.895888:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940655.259654:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944863744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940655.259694:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944863616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940655.259737:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940655.260055:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944863744 00000100:00100000:3.0:1788940655.260064:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944863744 00000100:00100000:0.0:1788940655.260065:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940655.260139:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944863616 00000100:00100000:3.0:1788940655.260143:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944863616 00000100:00100000:3.0:1788940655.260160:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788940655.260169:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944863744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940655.260195:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940655.260251:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944863744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940655.260278:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788940655.260298:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788940655.260316:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944863616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788940655.260329:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788940655.260334:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940655.260383:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944863616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (319us total) trans 0 rc 0/0 00010000:00080000:0.0:1788940655.260448:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06ec5180 x1875839944863744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940655.260465:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944863744:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788940655.260683:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08548a80 x1875839944863616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940655.260696:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944863616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788940655.265027:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00010000:2.0:1788940655.900349:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940656.288452:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944863872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940656.288521:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940656.290354:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944863872 00000100:00100000:3.0:1788940656.290368:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944863872 00000100:00100000:3.0:1788940656.290419:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788940656.290428:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944863872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788940656.290465:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788940656.298284:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944863872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7846us (9752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940656.298299:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788940656.302384:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944863872:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788940656.923392:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940657.308639:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944864000:0@lo:400:kworker.0 00000100:00100000:1.0:1788940657.308727:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940657.308821:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944864128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940657.308853:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940657.308876:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944864256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940657.308892:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944864128 00000100:00100000:3.0:1788940657.308899:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944864128 00000100:00100000:2.0:1788940657.308925:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940657.308947:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944864256 00000100:00100000:3.0:1788940657.308950:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944864256 00000100:00100000:2.0:1788940657.308958:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788940657.308973:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944864128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788940657.309004:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940657.309047:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944864128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940657.316402:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940657.316426:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944864384:0@lo:400:kworker.0 00000100:00100000:1.0:1788940657.316504:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940657.316610:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944864000 00000100:00100000:1.0:1788940657.316628:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944864000 00000100:00100000:1.0:1788940657.316677:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788940657.316687:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944864000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940657.316743:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944864384 00000100:00100000:3.0:1788940657.316749:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944864384 00000100:00100000:1.0:1788940657.318307:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944864000:12345-0@lo:400:kworker.0 Request processed in 1615us (9574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940657.318319:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788940657.318394:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944864000:0@lo:400:kworker.0 00000100:00100000:1.0:1788940657.318446:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788940657.318683:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944864256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940657.318708:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940657.318765:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944864256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 311us (9839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940657.318772:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1788940657.318794:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788940657.319039:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06ec7800 x1875839944864128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940657.319059:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944864128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940657.319135:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788940657.319146:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944864384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940657.319193:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944864384:12345-0@lo:400:kworker.0 Request processed in 51us (2690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940657.319200:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788940657.319227:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944864384:0@lo:400:kworker.0 00010000:00080000:3.0:1788940657.319283:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08548a80 x1875839944864256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940657.319296:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944864256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940657.320340:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788940657.322039:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944864640:0@lo:400:kworker.0 00000100:00100000:0.0:1788940657.322120:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940657.322359:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940657.322370:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944864512:0@lo:400:kworker.0 00000100:00100000:2.0:1788940657.322405:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940657.322444:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944864640 00000100:00100000:2.0:1788940657.322452:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944864640 00000100:00100000:2.0:1788940657.322497:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788940657.322506:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944864640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940657.322581:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944864640:12345-0@lo:400:kworker.0 Request processed in 76us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940657.322588:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788940657.322634:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944864512 00000100:00100000:2.0:1788940657.322638:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944864512 00000100:00100000:2.0:1788940657.322661:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788940657.322667:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944864512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940657.322703:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944864512:12345-0@lo:400:kworker.0 Request processed in 36us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940657.322709:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788940657.322747:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944864512:0@lo:400:kworker.0 00000100:00100000:0.0:1788940657.322910:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944864640:0@lo:400:kworker.0 00000100:00100000:3.0:1788940657.324075:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944864768:0@lo:400:kworker.0 00000100:00100000:3.0:1788940657.324143:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940657.324329:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944865280:0@lo:400:kworker.0 00000100:00100000:3.0:1788940657.324356:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940657.324380:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940657.324387:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944865152:0@lo:400:kworker.0 00000100:00100000:3.0:1788940657.324409:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940657.324438:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944865280 00000100:00100000:3.0:1788940657.324444:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944865280 00000100:00100000:3.0:1788940657.324498:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944865152 00000100:00100000:3.0:1788940657.324502:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944865152 00000100:00100000:3.0:1788940657.324532:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788940657.324540:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944865280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940657.324811:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788940657.324826:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944865152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940657.324863:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944865152:12345-0@lo:400:kworker.0 Request processed in 39us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940657.324869:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1788940657.324889:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940657.325025:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944864896:0@lo:400:kworker.0 00000100:00100000:2.0:1788940657.325059:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940657.325100:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944865408:0@lo:400:kworker.0 00000100:00100000:2.0:1788940657.325121:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940657.325140:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788940657.325146:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944865024:0@lo:400:kworker.0 00000100:00100000:2.0:1788940657.325295:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940657.325315:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944865536:0@lo:400:kworker.0 00000100:00100000:2.0:1788940657.325335:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940657.325361:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944864896 00000100:00100000:2.0:1788940657.325365:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944864896 00000100:00100000:2.0:1788940657.325396:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944865408 00000100:00100000:2.0:1788940657.325400:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944865408 00000100:00100000:2.0:1788940657.325412:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944865024 00000100:00100000:2.0:1788940657.325414:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944865024 00000100:00100000:2.0:1788940657.325424:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944865536 00000100:00100000:2.0:1788940657.325426:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944865536 00000100:00100000:2.0:1788940657.325437:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788940657.325443:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944864896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940657.325486:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944864896:12345-0@lo:400:kworker.0 Request processed in 43us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940657.325493:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788940657.325508:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788940657.325514:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944865408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940657.325554:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944865408:12345-0@lo:400:kworker.0 Request processed in 40us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940657.325560:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788940657.325582:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788940657.325589:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944865024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940657.325727:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944864768 00000100:00100000:0.0:1788940657.325741:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944864768 00000100:00100000:0.0:1788940657.325773:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788940657.325780:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944864768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940657.325842:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788940657.325850:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944865536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940657.337977:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944864768:12345-0@lo:400:kworker.0 Request processed in 12188us (13824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940657.337990:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1788940657.338075:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788940657.338080:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788940657.338133:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d034758000 x1875839944865152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940657.338145:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944865152:0@lo:400:kworker.0 00000100:00100000:0.0:1788940657.338153:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944864768:0@lo:400:kworker.0 00000100:00100000:0.0:1788940657.338213:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944864896:0@lo:400:kworker.0 00000100:00100000:0.0:1788940657.338226:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944865408:0@lo:400:kworker.0 00010000:00080000:0.0:1788940657.339157:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03475d180 x1875839944865536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940657.339168:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944865536:0@lo:400:kworker.0 00000100:00100000:1.0:1788940657.339209:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944865536:12345-0@lo:400:kworker.0 Request processed in 13206us (13717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940657.339220:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788940657.339752:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944865024:12345-0@lo:400:kworker.0 Request processed in 14161us (14454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940657.339760:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00010000:00080000:0.0:1788940657.347216:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d034759880 x1875839944865024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940657.347234:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944865024:0@lo:400:kworker.0 00000100:00100000:3.0:1788940657.351382:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944865280:12345-0@lo:400:kworker.0 Request processed in 26832us (27014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940657.351397:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:0.0:1788940657.351549:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03475bb80 x1875839944865280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940657.351573:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944865280:0@lo:400:kworker.0 00010000:00010000:0.0:1788940657.949828:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788940658.444685:0:13049:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788940658.971976:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940659.869835:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940659.869860:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944865664:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788940659.869926:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940659.873184:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944865664 00000100:00100000:2.0:1788940659.873199:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944865664 00000100:00100000:2.0:1788940659.873297:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788940659.873308:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944865664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940659.873346:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788940659.873426:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944865664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (3499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940659.873433:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788940659.873596:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944865664:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788940659.995377:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940660.007454:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940660.007510:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940660.007560:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940660.007583:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940660.007619:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940660.007650:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921704320 00000100:00100000:2.0:1788940660.007662:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921704320 00000100:00100000:2.0:1788940660.007719:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 324 00000100:00100000:2.0:1788940660.007731:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2404:x1875839921704320:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940660.007803:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2404:x1875839921704320:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 75us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940660.007811:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 324 00000100:00100000:3.0:1788940660.008455:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921704448 00000100:00100000:3.0:1788940660.008462:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921704448 00000100:00100000:1.0:1788940660.008594:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921704704 00000100:00100000:1.0:1788940660.008721:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921704704 00000100:00100000:1.0:1788940660.008764:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921704576 00000100:00100000:1.0:1788940660.008767:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921704576 00000100:00100000:1.0:1788940660.008778:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921704832 00000100:00100000:1.0:1788940660.008780:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921704832 00000100:00100000:1.0:1788940660.008795:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 228 00000100:00100000:1.0:1788940660.008803:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921704704:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940660.008849:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921704704:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 46us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940660.008855:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 228 00000100:00100000:1.0:1788940660.008870:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 229 00000100:00100000:1.0:1788940660.008887:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921704576:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940660.008911:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921704576:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 26us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940660.008917:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 229 00000100:00100000:1.0:1788940660.008928:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 230 00000100:00100000:1.0:1788940660.008934:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921704832:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940660.008955:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921704832:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 22us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940660.008961:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 230 00000100:00100000:3.0:1788940660.009141:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 231 00000100:00100000:3.0:1788940660.009148:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921704448:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940660.009174:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921704448:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 28us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940660.009180:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 231 00000100:00080000:2.0:1788940660.011891:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940660.011906:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940660.379789:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944865792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940660.379863:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940660.379988:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944865792 00000100:00100000:3.0:1788940660.379997:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944865792 00000100:00100000:3.0:1788940660.380063:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788940660.380073:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944865792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940660.380103:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940660.380149:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944865792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940660.380156:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:3.0:1788940660.380199:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06ec7800 x1875839944865792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940660.380218:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944865792:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788940660.380380:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940660.380599:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944865920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940660.380631:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940660.380730:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944865920 00000100:00100000:3.0:1788940660.380750:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944865920 00000100:00100000:3.0:1788940660.380793:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788940660.380800:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944865920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788940660.380811:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940660.380844:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944865920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940660.380851:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:3.0:1788940660.380877:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06ec7800 x1875839944865920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940660.380890:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944865920:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788940660.380968:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788940661.022456:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940661.414290:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940661.414326:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944866048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788940661.414436:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940661.414541:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944866048 00000100:00100000:2.0:1788940661.414553:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944866048 00000100:00100000:2.0:1788940661.414623:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788940661.414636:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944866048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940661.414692:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940661.414755:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944866048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940661.414764:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788940661.414834:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944866048:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788940662.043566:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940662.427823:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944866176:0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.427945:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940662.428016:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944866688:0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.428059:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940662.428086:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944867200:0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.428116:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940662.428136:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944867712:0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.428160:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940662.428193:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788940662.428200:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944866304:0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.428251:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940662.428335:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944866816:0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.428358:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940662.428380:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944867328:0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.428409:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940662.428444:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944866560:0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.428485:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940662.428505:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944867072:0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.428532:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940662.428552:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944867584:0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.428636:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940662.428661:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788940662.428668:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944866432:0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.428716:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940662.428743:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944866944:0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.428767:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940662.428786:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944867456:0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.428809:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940662.428842:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944866688 00000100:00100000:1.0:1788940662.428855:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944866688 00000100:00100000:1.0:1788940662.428912:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944866432 00000100:00100000:1.0:1788940662.428916:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944866432 00000100:00100000:1.0:1788940662.428937:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788940662.428948:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944866688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.429016:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944866688:12345-0@lo:400:kworker.0 Request processed in 68us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940662.429031:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788940662.429052:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788940662.429058:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944866432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.429093:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944866432:12345-0@lo:400:kworker.0 Request processed in 36us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940662.429099:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788940662.429119:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944867200 00000100:00100000:1.0:1788940662.429122:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944867200 00000100:00100000:1.0:1788940662.429158:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944867712 00000100:00100000:1.0:1788940662.429161:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944867712 00000100:00100000:1.0:1788940662.429172:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944867072 00000100:00100000:1.0:1788940662.429174:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944867072 00000100:00100000:1.0:1788940662.429185:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944867584 00000100:00100000:1.0:1788940662.429187:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944867584 00000100:00100000:1.0:1788940662.429201:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788940662.429206:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944867200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.429240:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944867200:12345-0@lo:400:kworker.0 Request processed in 33us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940662.429247:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788940662.429287:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788940662.429293:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944867712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.429322:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944867712:12345-0@lo:400:kworker.0 Request processed in 30us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940662.429328:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788940662.429340:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788940662.429346:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944867072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.429384:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944867072:12345-0@lo:400:kworker.0 Request processed in 39us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940662.429391:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788940662.429402:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788940662.429408:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944867584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940662.429435:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944867584:12345-0@lo:400:kworker.0 Request processed in 27us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940662.429440:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788940662.429465:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944866304 00000100:00100000:1.0:1788940662.429482:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944866304 00000100:00100000:1.0:1788940662.429505:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944866816 00000100:00100000:1.0:1788940662.429508:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944866816 00000100:00100000:1.0:1788940662.429521:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944867328 00000100:00100000:1.0:1788940662.429524:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944867328 00000100:00100000:1.0:1788940662.429535:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944866560 00000100:00100000:1.0:1788940662.429538:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944866560 00000100:00100000:1.0:1788940662.429548:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944866944 00000100:00100000:1.0:1788940662.429550:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944866944 00000100:00100000:1.0:1788940662.429563:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944867456 00000100:00100000:1.0:1788940662.429565:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944867456 00000100:00100000:0.0:1788940662.430099:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944866176 00000100:00100000:0.0:1788940662.430107:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944866176 00000100:00100000:0.0:1788940662.430145:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788940662.430153:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944866176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940662.430201:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944866176:12345-0@lo:400:kworker.0 Request processed in 49us (2258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940662.430208:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788940662.430437:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788940662.430448:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944866304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940662.430499:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944866304:12345-0@lo:400:kworker.0 Request processed in 54us (2247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940662.430520:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788940662.430540:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788940662.430546:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944866816:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788940662.430874:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940662.430881:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940662.430892:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940662.430896:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940662.430920:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788940662.430931:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944867328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940662.430977:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944867328:12345-0@lo:400:kworker.0 Request processed in 49us (2567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940662.430984:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788940662.431000:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788940662.431007:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944866560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940662.431051:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944866560:12345-0@lo:400:kworker.0 Request processed in 44us (2565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940662.431058:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788940662.431070:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788940662.431075:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944866944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940662.431105:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944866944:12345-0@lo:400:kworker.0 Request processed in 30us (2338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940662.431112:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788940662.431123:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788940662.431129:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944867456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940662.431159:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944867456:12345-0@lo:400:kworker.0 Request processed in 31us (2350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940662.431165:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788940662.431218:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034759880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944866432:0@lo:400:kworker.0 00010000:00080000:2.0:1788940662.431239:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d034758000 x1875839944866944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940662.431286:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944866944:0@lo:400:kworker.0 00010000:00080000:2.0:1788940662.431303:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08586d80 x1875839944867456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940662.431312:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944867456:0@lo:400:kworker.0 00000100:00100000:2.0:1788940662.431326:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944866560:0@lo:400:kworker.0 00010000:00080000:2.0:1788940662.431338:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08586a00 x1875839944867072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940662.431347:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944867072:0@lo:400:kworker.0 00010000:00080000:2.0:1788940662.431360:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08585880 x1875839944867584/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940662.431367:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944867584:0@lo:400:kworker.0 00000100:00100000:2.0:1788940662.431420:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944866304:0@lo:400:kworker.0 00000100:00100000:2.0:1788940662.431433:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944866816:0@lo:400:kworker.0 00000100:00100000:2.0:1788940662.431447:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944867328:0@lo:400:kworker.0 00000100:00100000:2.0:1788940662.431458:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944866176:0@lo:400:kworker.0 00000100:00100000:2.0:1788940662.431482:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944866688:0@lo:400:kworker.0 00010000:00080000:2.0:1788940662.431498:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08584380 x1875839944867200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940662.431507:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944867200:0@lo:400:kworker.0 00010000:00080000:2.0:1788940662.431532:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08585f80 x1875839944867712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940662.431542:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944867712:0@lo:400:kworker.0 00000100:00100000:0.0:1788940662.431841:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944866816:12345-0@lo:400:kworker.0 Request processed in 31us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940662.431851:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788940662.432093:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944867840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940662.432160:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940662.432216:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944867840 00000100:00100000:2.0:1788940662.432224:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944867840 00000100:00100000:2.0:1788940662.432287:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788940662.432297:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944867840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788940662.432330:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940662.432372:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944867840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940662.432378:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:2.0:1788940662.432416:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08586300 x1875839944867840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940662.432433:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944867840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940662.445323:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d001379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944867968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940662.445442:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940662.445598:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944867968 00000100:00100000:2.0:1788940662.445610:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944867968 00000100:00100000:2.0:1788940662.445688:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788940662.445699:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944867968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940662.445732:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940662.445794:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944867968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940662.445803:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:2.0:1788940662.445856:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d001379880 x1875839944867968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940662.445900:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d001379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944867968:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940663.067391:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788940663.476539:0:13196:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed1ed2d60 20000000:00000080:2.0:1788940663.476555:0:13196:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91d035951800 uarg=0000000000000000 20000000:01000000:2.0:1788940663.476594:0:13196:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788940663.476599:0:13196:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788940663.476603:0:13196:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788940663.478683:0:13197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788940663.480165:0:13196:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788940663.484896:0:13196:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788940663.484987:0:13196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd25f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.485005:0:13196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d02eaaa800/0x9c34acc08badd1ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc715d expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.485012:0:13196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d0355e6800/0x9c34acc08badd1fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd1f6 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.485016:0:13196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd20b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd204 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.485027:0:13196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584d200/0x9c34acc08badd219 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd212 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.485032:0:13196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d0355e6200/0x9c34acc08badd227 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd220 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.485036:0:13196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584c800/0x9c34acc08badd23c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc719c expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.485054:0:13196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd25f lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.485090:0:13196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584c800/0x9c34acc08badd23c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc719c expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.485103:0:13196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584c800/0x9c34acc08badd23c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc719c expref: 12 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940663.485114:0:13196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13196:1875839944868096:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940663.485220:0:13196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d0355e6200/0x9c34acc08badd227 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badd220 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.485234:0:13196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d0355e6200/0x9c34acc08badd227 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badd220 expref: 23 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940663.485243:0:13196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08548a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13196:1875839944868224:0@lo:104: 00000100:00100000:3.0:1788940663.485310:0:13196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940663.485350:0:13196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584d200/0x9c34acc08badd219 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badd212 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.485356:0:13196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584d200/0x9c34acc08badd219 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badd212 expref: 23 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940663.485362:0:13196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07847480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13196:1875839944868352:0@lo:104: 00000100:00100000:3.0:1788940663.485376:0:13196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940663.485399:0:13196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd20b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badd204 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940663.485499:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944868224 00000100:00100000:1.0:1788940663.485508:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944868224 00000100:00100000:1.0:1788940663.485549:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944868352 00000100:00100000:1.0:1788940663.485552:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944868352 00000100:00100000:1.0:1788940663.485568:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788940663.485577:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:13196:x1875839944868224:12345-0@lo:104: 00010000:00010000:1.0:1788940663.485606:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd220 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd227 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940663.485674:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788940663.485680:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:13196:x1875839944868224:12345-0@lo:104: Request processed in 104us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940663.485687:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788940663.485704:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788940663.485710:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:13196:x1875839944868352:12345-0@lo:104: 00010000:00010000:1.0:1788940663.485718:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badd212 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd219 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.485725:0:13196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd20b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badd204 expref: 23 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940663.485750:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788940663.485756:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:13196:x1875839944868352:12345-0@lo:104: Request processed in 47us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940663.485763:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1788940663.485794:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940663.485802:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd220 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd227 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940663.485810:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaab000 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940663.485814:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd220 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badd227 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940663.485823:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd220 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badd227 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940663.485840:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd220 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badd227 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940663.485846:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788940663.485877:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd220 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd227 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940663.485884:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940663.485906:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd220 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd227 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940663.485919:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02eaab000/0x9c34acc08badd220 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd227 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940663.485931:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940663.485934:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badd212 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd219 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940663.485938:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c0a00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940663.485941:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badd212 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badd219 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940663.485948:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badd212 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badd219 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940663.485954:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badd212 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badd219 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940663.485958:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788940663.485972:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badd212 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd219 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940663.485978:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940663.485993:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badd212 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd219 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940663.485996:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d001379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944868608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940663.486005:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0421c0a00/0x9c34acc08badd212 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd219 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940663.486016:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940663.486023:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940663.486026:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940663.486032:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940663.486067:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944868608 00000100:00100000:1.0:1788940663.486070:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944868608 00010000:00010000:1.0:1788940663.486087:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d0355e6200/0x9c34acc08badd227 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd220 expref: 24 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940663.486109:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788940663.486113:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944868736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940663.486119:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944868608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940663.486131:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940663.486135:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d0355e6200/0x9c34acc08badd227 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd220 expref: 24 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940663.486156:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d0355e6200/0x9c34acc08badd227 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badd220 expref: 24 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940663.486164:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940663.486170:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940663.486352:0:13196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13196:1875839944868480:0@lo:104: 00000100:00100000:1.0:1788940663.486353:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944868608:12345-0@lo:103:ldlm_bl.0 Request processed in 235us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940663.486363:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788940663.486376:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944868736 00000100:00100000:1.0:1788940663.486380:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944868736 00000100:00100000:3.0:1788940663.486392:0:13196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940663.486396:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584d200/0x9c34acc08badd219 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd212 expref: 24 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940663.486421:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788940663.486427:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944868736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940663.486434:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940663.486438:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584d200/0x9c34acc08badd219 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd212 expref: 24 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940663.486443:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584d200/0x9c34acc08badd219 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badd212 expref: 24 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940663.486450:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940663.486480:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944868736:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940663.486487:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788940663.486527:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d001379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944868608:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940663.486658:0:13196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d0355e6800/0x9c34acc08badd1fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badd1f6 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.486669:0:13196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d0355e6800/0x9c34acc08badd1fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badd1f6 expref: 23 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940663.486678:0:13196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13196:1875839944868864:0@lo:104: 00000100:00100000:3.0:1788940663.486701:0:13196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940663.486734:0:13196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d02eaaa800/0x9c34acc08badd1ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc715d expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.486743:0:13196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d02eaaa800/0x9c34acc08badd1ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc715d expref: 12 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940663.486751:0:13196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07847b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13196:1875839944868992:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788940663.486803:0:13196:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d01969fa80 going to sleep for 11 seconds 00010000:00010000:3.0:1788940663.486818:0:13196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0355e6200/0x9c34acc08badd227 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badd220 expref: 23 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940663.486839:0:13196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08548a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13196:1875839944868224:0@lo:104: 00010000:00010000:3.0:1788940663.486850:0:13196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584d200/0x9c34acc08badd219 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badd212 expref: 22 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940663.486871:0:13196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07847480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13196:1875839944868352:0@lo:104: 00000100:00100000:2.0:1788940663.487055:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944868736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940663.487089:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944868480 00000100:00100000:1.0:1788940663.487100:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944868480 00000100:00100000:1.0:1788940663.487120:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944868864 00000100:00100000:1.0:1788940663.487122:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944868864 00000100:00100000:1.0:1788940663.487131:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788940663.487137:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:13196:x1875839944868480:12345-0@lo:104: 00010000:00010000:1.0:1788940663.487146:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badd204 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd20b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940663.487274:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788940663.487279:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:13196:x1875839944868480:12345-0@lo:104: Request processed in 143us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940663.487285:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788940663.487298:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788940663.487304:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:13196:x1875839944868864:12345-0@lo:104: 00010000:00010000:1.0:1788940663.487312:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd1f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd1fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940663.487314:0:10401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940663.487322:0:10401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badd204 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd20b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940663.487332:0:10401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c1200 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940663.487335:0:10401:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badd204 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badd20b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940663.487345:0:10401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badd204 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badd20b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940663.487347:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788940663.487357:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:13196:x1875839944868864:12345-0@lo:104: Request processed in 51us (653us total) trans 0 rc 0/0 10000000:00010000:2.0:1788940663.487359:0:10401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badd204 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badd20b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940663.487368:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788940663.487370:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1788940663.487371:0:10401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788940663.487378:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd1f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd1fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940663.487385:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584de00 already unused, calling callback (ffffffffc12d7c20) 00010000:00010000:1.0:1788940663.487386:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1788940663.487389:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd1f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badd1fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940663.487392:0:10401:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badd204 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd20b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940663.487397:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd1f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badd1fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940663.487398:0:10401:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1788940663.487403:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd1f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badd1fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940663.487408:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788940663.487422:0:10401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badd204 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd20b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940663.487429:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0421c1200/0x9c34acc08badd204 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd20b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940663.487451:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940663.487453:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940663.487455:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940663.487475:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940663.487487:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944869120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940663.487518:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788940663.487584:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd1f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd1fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940663.487589:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940663.487608:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd1f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd1fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940663.487622:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd1f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd1fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940663.487624:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944869248:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940663.487635:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940663.487637:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940663.487639:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940663.487657:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944869120 00000100:00100000:0.0:1788940663.487662:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944869120 00010000:00010000:0.0:1788940663.487681:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd20b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd204 expref: 22 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940663.487704:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788940663.487711:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:3645:x1875839944869120:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940663.487717:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788940663.487719:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940663.487724:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd20b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd204 expref: 22 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940663.487733:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd20b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badd204 expref: 22 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940663.487745:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940663.487778:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:3645:x1875839944869120:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940663.487785:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788940663.487799:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944869248 00000100:00100000:0.0:1788940663.487803:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944869248 00010000:00010000:0.0:1788940663.487815:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d0355e6800/0x9c34acc08badd1fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd1f6 expref: 22 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940663.487852:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788940663.487859:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:3647:x1875839944869248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940663.487867:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940663.487870:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d0355e6800/0x9c34acc08badd1fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd1f6 expref: 22 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940663.487878:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d0355e6800/0x9c34acc08badd1fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badd1f6 expref: 22 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940663.487887:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940663.487912:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944869120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940663.487921:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:3647:x1875839944869248:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940663.487927:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788940663.488000:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944869248:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940663.488402:0:13196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd20b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badd204 expref: 21 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940663.488539:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940663.488731:0:13196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13196:1875839944868480:0@lo:104: 00010000:00010000:3.0:1788940663.488747:0:13196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0355e6800/0x9c34acc08badd1fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badd1f6 expref: 20 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940663.488756:0:13196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13196:1875839944868864:0@lo:104: 00000100:00100000:3.0:1788940663.488765:0:13196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13196:1875839944868096:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788940663.490186:0:13196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07847b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13196:1875839944868992:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940663.490234:0:13196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd25f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940663.490625:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940663.490830:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921704960 00000100:00100000:0.0:1788940663.490838:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921704960 00010000:00010000:0.0:1788940663.490874:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584c800/0x9c34acc08badd23c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc719c expref: 13 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940663.490898:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921705088 00000100:00100000:0.0:1788940663.490901:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921705088 00010000:00010000:0.0:1788940663.490912:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d02eaaa800/0x9c34acc08badd1ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc715d expref: 14 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940663.490934:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:0.0:1788940663.490942:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+14:2405:x1875839921704960:12345-192.168.202.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788940663.490946:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00100000:3.0:1788940663.490953:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9d4689c-491f-4d5c-b012-ebe6beb5c037+14:2404:x1875839921705088:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940663.490955:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940663.490960:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940663.490961:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584c800/0x9c34acc08badd23c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc719c expref: 14 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.490963:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d02eaaa800/0x9c34acc08badd1ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc715d expref: 14 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.490973:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d02eaaa800/0x9c34acc08badd1ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc715d expref: 14 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.490992:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaaa800/0x9c34acc08badd1ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc715d expref: 14 pid: 6512 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940663.490995:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584c800/0x9c34acc08badd23c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc719c expref: 14 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940663.491004:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584c800/0x9c34acc08badd23c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc719c expref: 14 pid: 6515 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.491015:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd25f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.491704:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd25f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940663.491714:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940663.491723:0:7474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd25f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.491729:0:7474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd25f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.491735:0:7474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd25f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.491742:0:7474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd25f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.491748:0:7474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c0e00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940663.491751:0:7474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd25f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.491759:0:7474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd25f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940663.491779:0:7474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd25f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940663.491779:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:2405:x1875839921704960:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 836us (3240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940663.491788:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 44 00010000:00010000:3.0:1788940663.491797:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940663.491818:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:2404:x1875839921705088:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 865us (1194us total) trans 0 rc 0/0 00010000:00010000:1.0:1788940663.491873:0:13196:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd25f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940663.491882:0:13196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd25f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940663.491899:0:13196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0421c0e00/0x9c34acc08badd25f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940663.492004:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 45 00010000:00010000:1.0:1788940664.091651:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788940664.603436:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788940664.603446:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d037817800 from 7 10000000:01000000:0.0:1788940664.603460:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788940664.603523:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd266 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940664.603538:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd266 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940664.603550:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd266 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940664.603579:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08587480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944869376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940664.603654:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940664.603735:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021ad9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788940664.604200:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944869376 00000100:00100000:1.0:1788940664.604218:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944869376 00000100:00100000:1.0:1788940664.604297:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788940664.604306:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944869376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940664.604319:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940664.604335:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaaa200/0x9c34acc08badd26d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd266 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940664.604357:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaaa200/0x9c34acc08badd26d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd266 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940664.604368:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaaa200/0x9c34acc08badd26d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd266 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940664.604378:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaaa200, rc 0) 00000100:00100000:1.0:1788940664.604434:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944869376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940664.604441:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788940664.604635:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08587480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944869376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940664.604651:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd266 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd26d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940664.604661:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd266 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd26d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940664.604729:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944869504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940664.604761:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940664.604796:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd540 going to sleep for 11 seconds 00000100:00100000:3.0:1788940664.604855:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944869504 00000100:00100000:3.0:1788940664.604860:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944869504 00000100:00100000:3.0:1788940664.604895:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788940664.604904:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944869504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940664.605036:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944869504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940664.605044:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788940664.605346:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944869504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940664.605382:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944869632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940664.605426:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940664.605471:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940664.605533:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944869632 00000100:00100000:0.0:1788940664.605538:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944869632 00000100:00100000:0.0:1788940664.605573:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788940664.605580:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944869632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940664.605666:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944869632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940664.605673:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788940664.606249:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944869632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788940664.607993:0:13216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788940664.610820:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788940664.610861:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940664.610872:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd266 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd26d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940664.610885:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd266 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd26d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940664.610897:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788940664.610899:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d035758800 from 7 10000000:01000000:2.0:1788940664.610902:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940664.611082:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e6e00/0x9c34acc08badd274 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940664.611091:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d0355e6e00/0x9c34acc08badd274 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940664.611102:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d0355e6e00/0x9c34acc08badd274 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940664.611126:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944869760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940664.611472:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940664.611559:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940664.611605:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944869760 00000100:00100000:0.0:1788940664.611613:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944869760 00000100:00100000:0.0:1788940664.611689:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788940664.611706:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944869760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940664.611720:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940664.611733:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584c200/0x9c34acc08badd27b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd274 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940664.611763:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584c200/0x9c34acc08badd27b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd274 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940664.611773:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584c200/0x9c34acc08badd27b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd274 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940664.611781:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c200, rc 0) 00000100:00100000:0.0:1788940664.611855:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944869760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940664.611862:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788940664.612600:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944869760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940664.612621:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d0355e6e00/0x9c34acc08badd274 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd27b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940664.612632:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d0355e6e00/0x9c34acc08badd274 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd27b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940664.612847:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944869888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940664.612887:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940664.612913:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd540 going to sleep for 11 seconds 00000100:00100000:3.0:1788940664.613230:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944869888 00000100:00100000:3.0:1788940664.613238:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944869888 00000100:00100000:3.0:1788940664.613305:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788940664.613315:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944869888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940664.614222:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944869888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 904us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940664.614232:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788940664.614567:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944869888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940664.614624:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944870016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940664.614680:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940664.614872:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940664.614986:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944870016 00000100:00100000:0.0:1788940664.614994:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944870016 00000100:00100000:0.0:1788940664.615191:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788940664.615202:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944870016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940664.615338:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944870016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940664.615355:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788940664.615469:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944870016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788940664.618842:0:13217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788940664.619146:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788940664.619553:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788940664.619565:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e6e00/0x9c34acc08badd274 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd27b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940664.619577:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d0355e6e00/0x9c34acc08badd274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd27b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940664.619588:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788940664.619591:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d034739000 from 7 10000000:01000000:0.0:1788940664.619593:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788940664.619635:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08badd282 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940664.619643:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08badd282 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940664.619653:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08badd282 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940664.619679:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944870144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940664.619872:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940664.619959:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050f5240 going to sleep for 11 seconds 00000100:00100000:1.0:1788940664.620563:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944870144 00000100:00100000:1.0:1788940664.620573:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944870144 00000100:00100000:1.0:1788940664.620660:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788940664.620672:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944870144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940664.620715:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940664.620730:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badd289 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd282 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940664.620848:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badd289 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd282 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940664.620860:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badd289 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd282 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940664.620870:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaabe00, rc 0) 00000100:00100000:1.0:1788940664.620929:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944870144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 259us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940664.620936:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788940664.621043:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944870144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940664.621057:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08badd282 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940664.621067:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08badd282 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940664.621146:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944870272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940664.621193:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940664.621816:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050f5240 going to sleep for 11 seconds 00000100:00100000:1.0:1788940664.621952:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944870272 00000100:00100000:1.0:1788940664.621959:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944870272 00000100:00100000:1.0:1788940664.621985:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788940664.621993:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944870272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940664.622141:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944870272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940664.622149:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788940664.622416:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944870272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940664.622463:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944870400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940664.622507:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940664.622534:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050f5240 going to sleep for 11 seconds 00000100:00100000:1.0:1788940664.622632:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944870400 00000100:00100000:1.0:1788940664.622638:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944870400 00000100:00100000:1.0:1788940664.622656:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788940664.622661:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944870400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940664.622765:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944870400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940664.622782:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788940664.622950:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944870400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788940664.636550:0:13218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788940664.646820:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788940664.646862:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940664.646874:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08badd282 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940664.646887:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08badd282 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940664.646899:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788940664.646902:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d004f4a000 from 7 10000000:01000000:1.0:1788940664.646905:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940664.646953:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badd290 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940664.646961:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badd290 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940664.646973:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badd290 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940664.647000:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944870528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788940664.647085:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940664.647134:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03994d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788940664.647163:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944870528 00000100:00100000:1.0:1788940664.647184:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944870528 00000100:00100000:1.0:1788940664.647519:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788940664.647532:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944870528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940664.647545:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940664.647569:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badd297 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd290 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940664.647600:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badd297 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd290 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940664.647614:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badd297 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd290 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940664.647622:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaaa400, rc 0) 00000100:00100000:1.0:1788940664.647665:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944870528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940664.647672:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788940664.653822:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944870528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940664.653853:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badd290 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd297 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940664.653867:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badd290 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd297 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940664.653954:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944870656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940664.654013:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940664.654047:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03994d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788940664.654142:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944870656 00000100:00100000:3.0:1788940664.654150:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944870656 00000100:00100000:3.0:1788940664.654198:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788940664.654209:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944870656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940664.654360:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944870656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940664.654368:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788940664.654711:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944870656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940664.654741:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944870784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940664.654785:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940664.654805:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03994d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788940664.654823:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944870784 00000100:00100000:1.0:1788940664.654828:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944870784 00000100:00100000:1.0:1788940664.654852:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788940664.654859:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944870784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940664.654935:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944870784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940664.654943:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788940664.654984:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944870784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788940664.655742:0:13219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788940664.655802:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788940664.655818:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940664.655826:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badd290 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd297 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940664.655837:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badd290 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd297 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940664.810380:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940664.810717:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921705216 00000100:00100000:3.0:1788940664.810728:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921705216 00000100:00100000:3.0:1788940664.810795:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 338 00000100:00100000:3.0:1788940664.810806:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:6193:x1875839921705216:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940664.810838:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940664.810857:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd29e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc71cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940664.810886:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd29e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71cd expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940664.810898:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd29e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71cd expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940664.810907:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0421c0c00, rc 0) 00000100:00100000:3.0:1788940664.810966:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:6193:x1875839921705216:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 Request processed in 162us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940664.810973:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 338 00000100:00100000:2.0:1788940664.822725:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940664.824409:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921705344 00000100:00100000:3.0:1788940664.824421:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921705344 00000100:00100000:3.0:1788940664.824521:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 339 00000100:00100000:3.0:1788940664.824531:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:6193:x1875839921705344:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940664.824684:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:6193:x1875839921705344:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 Request processed in 153us (1966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940664.824704:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 339 00000100:00100000:2.0:1788940664.847071:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940664.847126:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921705472 00000100:00100000:1.0:1788940664.847138:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921705472 00000100:00100000:1.0:1788940664.847215:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 340 00000100:00100000:1.0:1788940664.847226:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:6193:x1875839921705472:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940664.847394:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:6193:x1875839921705472:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 Request processed in 160us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940664.866641:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940664.866699:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921705600 00000100:00100000:2.0:1788940664.866710:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921705600 00000100:00100000:2.0:1788940664.866766:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 341 00000100:00100000:2.0:1788940664.866777:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:6193:x1875839921705600:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940664.866794:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940664.866811:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd2a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc71d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940664.866843:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd2a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71d4 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940664.866855:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd2a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71d4 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940664.866880:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7200, rc 0) 00000100:00100000:2.0:1788940664.866935:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+14:6193:x1875839921705600:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 Request processed in 159us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940664.866942:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 341 00000100:00100000:1.0:1788940664.877558:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 340 00000100:00100000:2.0:1788940664.879145:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940664.880963:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921705728 00000100:00100000:3.0:1788940664.880978:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921705728 00000100:00100000:3.0:1788940664.881043:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 342 00000100:00100000:3.0:1788940664.881053:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:6193:x1875839921705728:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940664.881222:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:6193:x1875839921705728:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 Request processed in 170us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940664.881243:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 342 00000100:00100000:3.0:1788940664.883244:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940664.883391:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921705856 00000100:00100000:1.0:1788940664.883401:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921705856 00000100:00100000:1.0:1788940664.883459:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 343 00000100:00100000:1.0:1788940664.883483:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:6193:x1875839921705856:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940664.883614:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:6193:x1875839921705856:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 Request processed in 133us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940664.883622:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 343 00000100:00100000:1.0:1788940664.987374:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944870912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788940664.987442:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940664.987519:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944870912 00000100:00100000:1.0:1788940664.987526:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944870912 00000100:00100000:1.0:1788940664.987578:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788940664.987587:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944870912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788940664.987692:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788940664.987752:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944870912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 166us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940664.987760:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788940664.988005:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944870912:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788940665.118214:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940665.129623:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940665.129703:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940665.129708:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921705984 00000100:00100000:0.0:1788940665.129728:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921705984 00000100:00100000:3.0:1788940665.129761:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940665.129828:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940665.129848:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921706240 00000100:00100000:0.0:1788940665.129855:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921706240 00000100:00100000:0.0:1788940665.129887:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921706112 00000100:00100000:0.0:1788940665.129892:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921706112 00000100:00100000:3.0:1788940665.129895:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921706368 00000100:00100000:3.0:1788940665.129906:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921706368 00000100:00100000:0.0:1788940665.129922:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 238 00000100:00100000:0.0:1788940665.129935:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921705984:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940665.129965:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 239 00000100:00100000:3.0:1788940665.129980:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921706240:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940665.130059:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921705984:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 124us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940665.130070:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921706240:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 87us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940665.130082:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 238 00000100:00100000:3.0:1788940665.133355:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 239 00000100:00100000:3.0:1788940665.133418:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 240 00000100:00100000:3.0:1788940665.133438:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921706112:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940665.133562:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921706112:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 133us (3803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940665.133570:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 240 00000100:00100000:3.0:1788940665.133591:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 241 00000100:00100000:3.0:1788940665.133600:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921706368:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940665.133647:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921706368:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 33us (3808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940665.133655:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 241 00000100:00080000:1.0:1788940665.139496:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940665.139510:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940665.500253:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944871040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940665.500345:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940665.500429:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944871040 00000100:00100000:3.0:1788940665.500437:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944871040 00000100:00100000:3.0:1788940665.500502:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788940665.500512:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944871040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940665.500540:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940665.500585:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944871040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940665.500592:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:3.0:1788940665.500637:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07846d80 x1875839944871040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940665.500656:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944871040:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788940665.501089:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940665.506013:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940665.506042:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944871168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940665.506322:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940665.506395:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944871168 00000100:00100000:3.0:1788940665.506404:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944871168 00000100:00100000:3.0:1788940665.506476:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788940665.506486:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944871168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788940665.506513:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940665.506558:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944871168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940665.506564:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1788940665.506610:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08586300 x1875839944871168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940665.506667:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944871168:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788940665.506692:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788940666.139645:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940666.524472:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944871296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940666.524546:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940666.525318:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944871296 00000100:00100000:3.0:1788940666.525329:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944871296 00000100:00100000:3.0:1788940666.525379:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788940666.525390:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944871296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788940666.525439:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788940666.525500:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944871296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940666.525507:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788940666.525551:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944871296:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788940667.168285:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940667.548100:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944871424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940667.548177:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940667.548314:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944871424 00000100:00100000:2.0:1788940667.548324:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944871424 00000100:00100000:2.0:1788940667.548389:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788940667.548399:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944871424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788940667.548443:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940667.548488:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944871424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940667.548496:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1788940667.548519:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788940667.548550:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d00137aa00 x1875839944871424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940667.548570:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944871424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788940667.549667:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944871552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940667.549718:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940667.549796:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944871552 00000100:00100000:1.0:1788940667.549802:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944871552 00000100:00100000:1.0:1788940667.549842:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788940667.549850:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944871552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940667.549866:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940667.549915:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944871552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940667.549922:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1788940667.549940:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788940667.549972:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf0852ed80 x1875839944871552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940667.549993:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944871552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940667.556898:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944871808:0@lo:400:kworker.0 00000100:00100000:3.0:1788940667.556971:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940667.557027:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944871808 00000100:00100000:3.0:1788940667.557033:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944871808 00000100:00100000:3.0:1788940667.557075:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788940667.557083:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944871808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940667.557128:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944871808:12345-0@lo:400:kworker.0 Request processed in 46us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940667.557134:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788940667.557170:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944871808:0@lo:400:kworker.0 00000100:00100000:3.0:1788940667.557206:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944871936:0@lo:400:kworker.0 00000100:00100000:3.0:1788940667.557232:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940667.557339:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944872320:0@lo:400:kworker.0 00000100:00100000:3.0:1788940667.557359:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940667.557396:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944872448:0@lo:400:kworker.0 00000100:00100000:1.0:1788940667.557526:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944871936 00000100:00100000:1.0:1788940667.557531:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944871936 00000100:00100000:1.0:1788940667.557558:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788940667.557564:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944871936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940667.557595:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944871936:12345-0@lo:400:kworker.0 Request processed in 32us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940667.557601:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788940667.557615:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944872320 00000100:00100000:1.0:1788940667.557618:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944872320 00000100:00100000:1.0:1788940667.557642:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788940667.557647:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944872320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940667.557670:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944872320:12345-0@lo:400:kworker.0 Request processed in 23us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940667.557675:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788940667.557694:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944871680:0@lo:400:kworker.0 00000100:00100000:1.0:1788940667.557718:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940667.557737:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944872192:0@lo:400:kworker.0 00000100:00100000:1.0:1788940667.557752:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940667.557767:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940667.557778:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944872064:0@lo:400:kworker.0 00000100:00100000:1.0:1788940667.557803:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944871680 00000100:00100000:1.0:1788940667.557806:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944871680 00000100:00100000:1.0:1788940667.557830:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788940667.557835:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944871680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940667.557861:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944871680:12345-0@lo:400:kworker.0 Request processed in 26us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940667.557867:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788940667.557886:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944872192 00000100:00100000:1.0:1788940667.557889:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944872192 00000100:00100000:1.0:1788940667.557905:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788940667.557909:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944872192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940667.557932:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944872192:12345-0@lo:400:kworker.0 Request processed in 22us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940667.557938:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1788940667.557951:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940667.558598:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944872576:0@lo:400:kworker.0 00000100:00100000:2.0:1788940667.558637:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940667.558658:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940667.558672:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944872704:0@lo:400:kworker.0 00000100:00100000:2.0:1788940667.558697:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940667.558765:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944872576 00000100:00100000:1.0:1788940667.558770:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944872576 00000100:00100000:1.0:1788940667.558813:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944872704 00000100:00100000:1.0:1788940667.558816:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944872704 00000100:00100000:1.0:1788940667.558838:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788940667.558845:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035df1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944872576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940667.558882:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035df1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944872576:12345-0@lo:400:kworker.0 Request processed in 37us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940667.558888:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788940667.559039:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788940667.559046:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944872704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940667.559081:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944872704:12345-0@lo:400:kworker.0 Request processed in 36us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940667.559087:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788940667.559160:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940667.559212:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944871936:0@lo:400:kworker.0 00000100:00100000:3.0:1788940667.559229:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944872960:0@lo:400:kworker.0 00000100:00100000:3.0:1788940667.559280:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940667.559297:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940667.559303:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839944872832:0@lo:400:kworker.0 00000100:00100000:3.0:1788940667.559324:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940667.559352:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944872448 00000100:00100000:3.0:1788940667.559355:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944872448 00000100:00100000:3.0:1788940667.559382:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944872960 00000100:00100000:3.0:1788940667.559385:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944872960 00000100:00100000:3.0:1788940667.559402:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944872832 00000100:00100000:3.0:1788940667.559405:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944872832 00000100:00100000:3.0:1788940667.559556:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788940667.559563:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944872448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940667.559599:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944872448:12345-0@lo:400:kworker.0 Request processed in 38us (2185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940667.559605:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788940667.559619:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788940667.559626:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944872960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940667.559650:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944872960:12345-0@lo:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940667.559656:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788940667.559677:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788940667.559683:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839944872832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940667.559710:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839944872832:12345-0@lo:400:kworker.0 Request processed in 28us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940667.559716:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788940667.559740:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940667.559766:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944871680:0@lo:400:kworker.0 00000100:00100000:3.0:1788940667.559778:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944872192:0@lo:400:kworker.0 00000100:00100000:3.0:1788940667.559795:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944872064 00000100:00100000:3.0:1788940667.559798:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944872064 00000100:00100000:3.0:1788940667.559819:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788940667.559825:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944872064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940667.559856:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944872064:12345-0@lo:400:kworker.0 Request processed in 31us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940667.559861:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788940667.559885:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944872064:0@lo:400:kworker.0 00000100:00100000:3.0:1788940667.559911:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944872320:0@lo:400:kworker.0 00000100:00100000:3.0:1788940667.559930:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839944872832:0@lo:400:kworker.0 00010000:00080000:3.0:1788940667.559941:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf0852f800 x1875839944872960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940667.559951:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944872960:0@lo:400:kworker.0 00010000:00080000:3.0:1788940667.559961:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf086fc380 x1875839944872448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940667.559982:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944872448:0@lo:400:kworker.0 00000100:00080000:2.0:1788940667.560723:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940667.560729:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940667.560731:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788940667.560760:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf0852d500 x1875839944872704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940667.560771:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944872704:0@lo:400:kworker.0 00010000:00080000:2.0:1788940667.560781:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf0852fb80 x1875839944872576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940667.560789:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944872576:0@lo:400:kworker.0 00010000:00010000:3.0:1788940668.187527:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788940668.201138:0:13395:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788940669.211521:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940670.108527:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d001378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944873088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788940670.108604:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940670.108686:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944873088 00000100:00100000:2.0:1788940670.108695:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944873088 00000100:00100000:2.0:1788940670.108745:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788940670.108755:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944873088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940670.108789:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788940670.108835:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944873088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940670.108842:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788940670.108892:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d001378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944873088:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788940670.239067:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940670.247376:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940670.247443:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940670.247547:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921706496 00000100:00100000:1.0:1788940670.247560:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921706496 00000100:00100000:1.0:1788940670.247612:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 345 00000100:00100000:1.0:1788940670.247623:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2406:x1875839921706496:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940670.247705:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2406:x1875839921706496:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 84us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940670.247713:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 345 00000100:00100000:0.0:1788940670.247926:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921706624 00000100:00100000:0.0:1788940670.247931:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921706624 00000100:00100000:0.0:1788940670.247986:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 248 00000100:00100000:0.0:1788940670.248007:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+6:2406:x1875839921706624:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940670.248049:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+6:2406:x1875839921706624:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 43us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940670.248055:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 248 00000100:00080000:0.0:1788940670.248076:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940670.251191:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940670.251227:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940670.251281:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940670.251311:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921706880 00000100:00100000:3.0:1788940670.251319:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921706880 00000100:00100000:3.0:1788940670.251371:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921706752 00000100:00100000:3.0:1788940670.251373:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921706752 00000100:00100000:3.0:1788940670.251387:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921707008 00000100:00100000:3.0:1788940670.251389:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921707008 00000100:00100000:3.0:1788940670.251528:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 249 00000100:00100000:3.0:1788940670.251541:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921706880:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940670.251617:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921706880:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 79us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940670.253698:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 250 00000100:00100000:0.0:1788940670.253725:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921706752:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940670.253789:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 251 00000100:00100000:1.0:1788940670.253801:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921707008:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940670.253877:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921707008:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 79us (2621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940670.253885:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 251 00000100:00100000:0.0:1788940670.254045:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921706752:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 335us (2815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940670.254053:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 250 00000100:00080000:2.0:1788940670.264357:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940670.264370:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940670.265755:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 249 00000100:00100000:3.0:1788940670.619545:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940670.619568:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944873216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940670.619646:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940670.619716:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944873216 00000100:00100000:3.0:1788940670.619723:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944873216 00000100:00100000:3.0:1788940670.619781:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788940670.619792:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944873216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940670.619837:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940670.619884:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944873216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940670.619892:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:3.0:1788940670.619937:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf086fe680 x1875839944873216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940670.620433:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944873216:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788940670.620512:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940670.625082:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940670.625133:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944873344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788940670.625204:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940670.625277:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944873344 00000100:00100000:2.0:1788940670.625286:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944873344 00000100:00100000:2.0:1788940670.625342:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788940670.625352:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944873344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788940670.625378:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940670.625434:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944873344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940670.625441:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1788940670.625465:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788940670.625495:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08585f80 x1875839944873344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940670.625513:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944873344:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788940671.261145:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940671.645309:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944873472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788940671.645407:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940671.645552:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944873472 00000100:00100000:2.0:1788940671.645560:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944873472 00000100:00100000:2.0:1788940671.645611:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788940671.645621:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944873472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940671.645654:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940671.645716:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944873472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940671.645724:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788940671.645914:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944873472:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788940672.284906:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940672.667550:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944873856:0@lo:400:kworker.0 00000100:00100000:1.0:1788940672.667624:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940672.667682:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944874368:0@lo:400:kworker.0 00000100:00100000:1.0:1788940672.667707:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940672.667731:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944874880:0@lo:400:kworker.0 00000100:00100000:1.0:1788940672.667754:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940672.667779:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788940672.667785:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944873984:0@lo:400:kworker.0 00000100:00100000:1.0:1788940672.667823:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940672.667843:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944874496:0@lo:400:kworker.0 00000100:00100000:1.0:1788940672.667865:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940672.667883:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944875008:0@lo:400:kworker.0 00000100:00100000:1.0:1788940672.667904:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940672.667956:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944874368 00000100:00100000:1.0:1788940672.667964:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944874368 00000100:00100000:1.0:1788940672.668018:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944874880 00000100:00100000:1.0:1788940672.668021:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944874880 00000100:00100000:1.0:1788940672.668039:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944873984 00000100:00100000:1.0:1788940672.668041:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944873984 00000100:00100000:1.0:1788940672.668055:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788940672.668062:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944874368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940672.668187:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944874368:12345-0@lo:400:kworker.0 Request processed in 124us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940672.668195:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788940672.668213:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788940672.668219:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944874880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940672.668246:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944874880:12345-0@lo:400:kworker.0 Request processed in 28us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940672.668252:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788940672.668287:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788940672.668293:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944873984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940672.668322:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944873984:12345-0@lo:400:kworker.0 Request processed in 29us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940672.668328:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788940672.668358:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944874496 00000100:00100000:1.0:1788940672.668362:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944874496 00000100:00100000:1.0:1788940672.668398:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944875008 00000100:00100000:1.0:1788940672.668401:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944875008 00000100:00100000:1.0:1788940672.668420:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788940672.668427:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944874496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940672.668458:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944874496:12345-0@lo:400:kworker.0 Request processed in 31us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940672.668465:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788940672.668476:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788940672.668482:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944875008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940672.668510:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944875008:12345-0@lo:400:kworker.0 Request processed in 28us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940672.668516:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788940672.668565:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944873984:0@lo:400:kworker.0 00010000:00080000:1.0:1788940672.668579:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf0852f800 x1875839944874496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940672.668590:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944874496:0@lo:400:kworker.0 00010000:00080000:1.0:1788940672.668600:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07847800 x1875839944875008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940672.668608:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944875008:0@lo:400:kworker.0 00010000:00080000:1.0:1788940672.668620:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf0852d500 x1875839944874368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940672.668628:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944874368:0@lo:400:kworker.0 00010000:00080000:1.0:1788940672.668637:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf0852dc00 x1875839944874880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940672.668654:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944874880:0@lo:400:kworker.0 00000100:00100000:2.0:1788940672.668960:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944873728:0@lo:400:kworker.0 00000100:00100000:2.0:1788940672.669004:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940672.669030:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944874240:0@lo:400:kworker.0 00000100:00100000:2.0:1788940672.669051:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940672.669078:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944874752:0@lo:400:kworker.0 00000100:00100000:2.0:1788940672.669440:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940672.669465:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d001379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944875264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940672.669492:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940672.669521:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788940672.669528:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944873600:0@lo:400:kworker.0 00000100:00100000:2.0:1788940672.669556:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940672.669579:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944874112:0@lo:400:kworker.0 00000100:00100000:2.0:1788940672.669601:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940672.669619:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944874624:0@lo:400:kworker.0 00000100:00100000:2.0:1788940672.669641:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940672.669658:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944875136:0@lo:400:kworker.0 00000100:00100000:2.0:1788940672.669677:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940672.669705:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944873856 00000100:00100000:2.0:1788940672.669710:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944873856 00000100:00100000:2.0:1788940672.669742:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944874112 00000100:00100000:2.0:1788940672.669745:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944874112 00000100:00100000:2.0:1788940672.669759:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788940672.669766:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944873856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940672.669810:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944873856:12345-0@lo:400:kworker.0 Request processed in 45us (2187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940672.669817:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788940672.669835:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788940672.669841:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944874112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940672.669873:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944874112:12345-0@lo:400:kworker.0 Request processed in 32us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940672.669891:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788940672.669912:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944873728 00000100:00100000:2.0:1788940672.669916:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944873728 00000100:00100000:3.0:1788940672.670863:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944874240 00000100:00100000:3.0:1788940672.670873:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944874240 00000100:00100000:3.0:1788940672.670901:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944874752 00000100:00100000:3.0:1788940672.670904:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944874752 00000100:00100000:3.0:1788940672.670920:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788940672.670927:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944873728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940672.671106:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944873728:12345-0@lo:400:kworker.0 Request processed in 179us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940672.671114:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788940672.671130:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788940672.671136:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944874240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940672.671166:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944874240:12345-0@lo:400:kworker.0 Request processed in 31us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940672.671172:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788940672.671183:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788940672.671190:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944874752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940672.671217:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944874752:12345-0@lo:400:kworker.0 Request processed in 28us (1777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940672.671233:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788940672.671285:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944873600 00000100:00100000:0.0:1788940672.671291:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944873600 00000100:00100000:0.0:1788940672.671322:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788940672.671328:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944873600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940672.671363:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944873600:12345-0@lo:400:kworker.0 Request processed in 36us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940672.671369:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788940672.671413:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944875264 00000100:00100000:0.0:1788940672.671418:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944875264 00000100:00100000:0.0:1788940672.671446:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788940672.671452:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944875264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940672.671481:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940672.671515:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944875264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (2023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940672.671522:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1788940672.671547:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940672.671552:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940672.671554:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940672.671557:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788940672.671703:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944874624 00000100:00100000:2.0:1788940672.671708:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944874624 00000100:00100000:2.0:1788940672.671746:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944875136 00000100:00100000:2.0:1788940672.671749:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944875136 00000100:00100000:2.0:1788940672.671767:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788940672.671774:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944874624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940672.671809:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944874624:12345-0@lo:400:kworker.0 Request processed in 36us (2167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940672.671814:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788940672.671828:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788940672.671833:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944875136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940672.671864:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944875136:12345-0@lo:400:kworker.0 Request processed in 31us (2187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940672.671870:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788940672.671915:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944873600:0@lo:400:kworker.0 00000100:00100000:2.0:1788940672.671930:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944874112:0@lo:400:kworker.0 00010000:00080000:2.0:1788940672.671959:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf0852c380 x1875839944874624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940672.671971:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944874624:0@lo:400:kworker.0 00010000:00080000:2.0:1788940672.671983:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07844000 x1875839944875136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940672.671991:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944875136:0@lo:400:kworker.0 00000100:00100000:2.0:1788940672.672012:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944873728:0@lo:400:kworker.0 00000100:00100000:2.0:1788940672.672023:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944874240:0@lo:400:kworker.0 00000100:00100000:2.0:1788940672.672033:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944874752:0@lo:400:kworker.0 00010000:00080000:2.0:1788940672.672042:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d001379880 x1875839944875264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940672.672054:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d001379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944875264:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788940672.672343:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940672.672627:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944873856:0@lo:400:kworker.0 00000100:00100000:1.0:1788940672.672774:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940672.672787:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944875392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788940672.672835:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940672.673788:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944875392 00000100:00100000:2.0:1788940672.673800:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944875392 00000100:00100000:2.0:1788940672.673893:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788940672.673904:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944875392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788940672.673929:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940672.674006:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944875392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940672.674014:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:1.0:1788940672.674091:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07844000 x1875839944875392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940672.674123:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944875392:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788940673.317600:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940674.333547:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940675.227744:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940675.227770:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944875520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940675.227847:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940675.228041:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944875520 00000100:00100000:0.0:1788940675.228050:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944875520 00000100:00100000:0.0:1788940675.228116:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788940675.228125:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944875520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788940675.228158:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788940675.228215:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944875520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940675.228222:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788940675.228302:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944875520:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788940675.356042:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940675.388616:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940675.388656:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940675.388673:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940675.388703:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940675.388724:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940675.389346:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921707392 00000100:00100000:1.0:1788940675.389370:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921707392 00000100:00100000:1.0:1788940675.389455:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921707648 00000100:00100000:1.0:1788940675.389459:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921707648 00000100:00100000:1.0:1788940675.389477:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921707264 00000100:00100000:1.0:1788940675.389480:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921707264 00000100:00100000:1.0:1788940675.389491:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921707520 00000100:00100000:1.0:1788940675.389493:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921707520 00000100:00100000:1.0:1788940675.389510:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 258 00000100:00100000:1.0:1788940675.389520:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921707392:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940675.389610:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921707392:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 90us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940675.389618:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 258 00000100:00100000:1.0:1788940675.389655:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 259 00000100:00100000:1.0:1788940675.389662:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921707648:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940675.389695:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921707648:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 33us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940675.389701:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 259 00000100:00100000:1.0:1788940675.389713:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 260 00000100:00100000:1.0:1788940675.389720:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921707264:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940675.389744:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921707264:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 25us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940675.389750:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 260 00000100:00100000:1.0:1788940675.389762:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 261 00000100:00100000:1.0:1788940675.389782:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921707520:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940675.389808:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921707520:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 40us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940675.389815:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 261 00000100:00100000:3.0:1788940675.390575:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921707136 00000100:00100000:3.0:1788940675.390583:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921707136 00000100:00100000:3.0:1788940675.390633:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 347 00000100:00100000:3.0:1788940675.390641:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2404:x1875839921707136:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940675.390681:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2404:x1875839921707136:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 41us (2075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940675.390688:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 347 00000100:00080000:0.0:1788940675.392413:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940675.392421:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788940675.741145:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944875776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940675.741237:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940675.741311:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940675.741318:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944875648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940675.741343:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940675.741631:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944875776 00000100:00100000:3.0:1788940675.741639:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944875776 00000100:00100000:3.0:1788940675.741690:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944875648 00000100:00100000:3.0:1788940675.741694:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944875648 00000100:00100000:3.0:1788940675.741713:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788940675.741722:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944875776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940675.741751:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940675.741795:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944875776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940675.741810:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788940675.741827:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788940675.741832:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944875648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788940675.741842:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940675.741864:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944875648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 32us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940675.741870:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:3.0:1788940675.741902:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf086ff100 x1875839944875648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940675.741990:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944875648:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788940675.742003:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf086fc700 x1875839944875776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940675.742013:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944875776:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788940675.742112:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788940675.803048:0:13544:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 03:57:54 (1788940674) === 00000100:00100000:0.0:1788940676.077092:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940676.077146:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940676.077512:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921707904 00000100:00100000:3.0:1788940676.077523:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921707904 00000100:00100000:3.0:1788940676.077582:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:3.0:1788940676.077593:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:82f3b232-46da-4a78-8599-45df2ddbced0+6:10547:x1875839921707904:12345-192.168.202.25@tcp:700:mkdir.0 00000100:00100000:2.0:1788940676.077795:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921707776 00000100:00100000:2.0:1788940676.077799:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921707776 00000100:00100000:2.0:1788940676.077831:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:2.0:1788940676.077839:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+7:2407:x1875839921707776:12345-192.168.202.25@tcp:41:mkdir.0 00000004:00000024:2.0:1788940676.077864:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788940676.078002:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:82f3b232-46da-4a78-8599-45df2ddbced0+7:10547:x1875839921707904:12345-192.168.202.25@tcp:700:mkdir.0 Request processed in 410us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940676.078012:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:3.0:1788940676.083071:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921707776:12345-192.168.202.25@tcp:41:mkdir.0 Request processed in 5222us (5982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940676.083152:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:0.0:1788940676.083388:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940676.083633:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921708160 00000100:00100000:3.0:1788940676.083641:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921708160 00000100:00100000:3.0:1788940676.083698:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:3.0:1788940676.083707:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+6:10547:x1875839921708160:12345-192.168.202.25@tcp:36:mkdir.0 00010000:00010000:3.0:1788940676.083772:0:9713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940676.083841:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badd14e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7148 expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.083862:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d0207af200) 00010000:00010000:3.0:1788940676.083874:0:9713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940676.083966:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.083979:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.083990:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.084024:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0800/0x9c34acc08badd2b3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.084032:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0800/0x9c34acc08badd2b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.084039:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0800/0x9c34acc08badd2b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.087236:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd2ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.087425:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd2ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.087513:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd2ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940676.087534:0:9713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c0180f3 reply state 000000008cd3bef8 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd2ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.087546:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd2ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.087552:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:0.0:1788940676.087555:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788940676.087559:0:9713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788940676.087566:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788940676.087574:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.087580:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2ac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.087586:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.087591:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c0200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940676.087595:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.087602:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2ac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.087611:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65400) 00010000:00010000:0.0:1788940676.087614:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940676.087624:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2ac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.087630:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2ac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940676.087648:0:9713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c0180f3 reply state 000000008cd3bef8 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0800/0x9c34acc08badd2b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.087656:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0800/0x9c34acc08badd2b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.087732:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91cf07e65f00) 00010000:00010000:0.0:1788940676.087734:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788940676.087736:0:9713:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788940676.087971:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+7:10547:x1875839921708160:12345-192.168.202.25@tcp:36:mkdir.0 Request processed in 4259us (4579us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788940676.087981:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:0.0:1788940676.102638:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940676.102931:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921708288 00000100:00100000:1.0:1788940676.102942:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921708288 00000100:00100000:1.0:1788940676.103013:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:1.0:1788940676.103024:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:10548:x1875839921708288:12345-192.168.202.25@tcp:101:chmod.0 00010000:00010000:1.0:1788940676.103045:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940676.103072:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa600/0x9c34acc08badd2c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc71db expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.103142:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd2c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.103169:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.103183:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940676.103232:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788940676.103236:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788940676.103311:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.103339:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa600/0x9c34acc08badd2c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71db expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.103370:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd2c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71db expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.103378:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfb500) 00010000:00010000:1.0:1788940676.103380:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940676.103384:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaab000, rc 0) 00000100:00100000:1.0:1788940676.103442:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+8:10548:x1875839921708288:12345-192.168.202.25@tcp:101:chmod.0 Request processed in 420us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940676.103449:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:2.0:1788940676.107250:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940676.107445:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921708544 00000100:00100000:3.0:1788940676.107457:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921708544 00000100:00100000:3.0:1788940676.107517:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:3.0:1788940676.107540:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+8:10548:x1875839921708544:12345-192.168.202.25@tcp:36:chmod.0 00010000:00010000:3.0:1788940676.107597:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940676.107637:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd2c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71db expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.107658:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfb500) 00010000:00010000:3.0:1788940676.107924:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940676.107957:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2cf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.107970:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.107981:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940676.108183:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0a08df1 reply state 00000000e529b29a transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.108197:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.108203:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65400) 00010000:00010000:3.0:1788940676.108207:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788940676.108210:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788940676.108219:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788940676.108407:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+9:10548:x1875839921708544:12345-192.168.202.25@tcp:36:chmod.0 Request processed in 867us (1166us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788940676.108415:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:0.0:1788940676.140659:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940676.143675:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921708672 00000100:00100000:1.0:1788940676.143692:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921708672 00000100:00100000:2.0:1788940676.145078:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:2.0:1788940676.145092:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+9:10549:x1875839921708672:12345-192.168.202.25@tcp:101:chown.0 00010000:00010000:2.0:1788940676.145132:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940676.145157:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd2d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc71e2 expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940676.145223:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd2dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940676.145239:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd2dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940676.145250:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd2dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940676.145330:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788940676.145334:0:9713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788940676.145383:0:9713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd2dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940676.145408:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd2d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71e2 expref: 11 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940676.145428:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd2dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71e2 expref: 10 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940676.145448:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65400) 00010000:00010000:2.0:1788940676.145451:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940676.145455:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6800, rc 0) 00000100:00100000:2.0:1788940676.145521:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+10:10549:x1875839921708672:12345-192.168.202.25@tcp:101:chown.0 Request processed in 432us (4873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940676.145529:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:0.0:1788940676.149314:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940676.149420:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921708800 00000100:00100000:1.0:1788940676.149507:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921708800 00000100:00100000:1.0:1788940676.149577:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:1.0:1788940676.149589:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+10:10549:x1875839921708800:12345-192.168.202.25@tcp:101:chown.0 00010000:00010000:1.0:1788940676.149630:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940676.149654:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa600/0x9c34acc08badd2e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc71e9 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.149724:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd2eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.149740:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd2eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.149752:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd2eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.149965:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab600/0x9c34acc08badd2f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.149976:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab600/0x9c34acc08badd2f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.149984:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab600/0x9c34acc08badd2f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150068:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd2f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150077:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150083:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940676.150128:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788940676.150137:0:8517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788940676.150162:0:8517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150174:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd2eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150181:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd2eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150188:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd2eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150194:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaaa800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940676.150199:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd2eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150207:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd2eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150218:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65400) 00010000:00010000:1.0:1788940676.150221:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940676.150226:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd2eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150232:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd2eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150244:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab600/0x9c34acc08badd2f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150251:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab600/0x9c34acc08badd2f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150304:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab600/0x9c34acc08badd2f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150310:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaab600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940676.150313:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab600/0x9c34acc08badd2f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150320:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab600/0x9c34acc08badd2f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150328:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91cf07e65f00) 00010000:00010000:1.0:1788940676.150331:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940676.150334:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab600/0x9c34acc08badd2f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150340:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab600/0x9c34acc08badd2f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150383:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa600/0x9c34acc08badd2e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71e9 expref: 12 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150397:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd2f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71e9 expref: 11 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.150404:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:1.0:1788940676.150406:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940676.150409:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaab000, rc 0) 00000100:00100000:1.0:1788940676.151574:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+11:10549:x1875839921708800:12345-192.168.202.25@tcp:101:chown.0 Request processed in 1980us (2263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940676.151598:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:0.0:1788940676.154981:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940676.155078:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921708928 00000100:00100000:1.0:1788940676.155089:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921708928 00000100:00100000:1.0:1788940676.155197:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:1.0:1788940676.155208:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:82f3b232-46da-4a78-8599-45df2ddbced0+11:10549:x1875839921708928:12345-192.168.202.25@tcp:900:chown.0 00000100:00100000:1.0:1788940676.155319:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:82f3b232-46da-4a78-8599-45df2ddbced0+11:10549:x1875839921708928:12345-192.168.202.25@tcp:900:chown.0 Request processed in 113us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940676.155328:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:0.0:1788940676.158110:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940676.158227:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921709184 00000100:00100000:3.0:1788940676.158735:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921709184 00000100:00100000:3.0:1788940676.158820:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:3.0:1788940676.158831:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+11:10549:x1875839921709184:12345-192.168.202.25@tcp:36:chown.0 00010000:00010000:3.0:1788940676.158900:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940676.159622:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd2f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71e9 expref: 11 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.159646:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:3.0:1788940676.159652:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940676.159685:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd300 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.159702:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd300 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.159712:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd300 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788940676.164559:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1788940676.164691:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0800/0x9c34acc08badd2b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940676.164712:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000493f03ed reply state 000000003c8b122d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd300 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.164713:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0800/0x9c34acc08badd2b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.164748:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0800/0x9c34acc08badd2b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.164759:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c0800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940676.164759:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd300 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.164767:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0800/0x9c34acc08badd2b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.164797:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0800/0x9c34acc08badd2b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.164817:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91cf07e65f00) 00010000:00010000:3.0:1788940676.164820:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940676.164827:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0800/0x9c34acc08badd2b3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.164833:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0800/0x9c34acc08badd2b3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.165152:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd2ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.165162:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd2ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.165169:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd2ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.165170:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:0.0:1788940676.165184:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788940676.165206:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584ca00 already unused, calling callback (ffffffffc18e84f0) 00000100:00100000:0.0:1788940676.165207:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788940676.165212:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd2ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.165222:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd2ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940676.165226:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788940676.165235:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:3.0:1788940676.165240:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940676.165244:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd2ba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.165380:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd2ba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.165401:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.165409:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.165414:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.165419:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c0200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940676.165423:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.165429:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.165438:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65400) 00010000:00010000:3.0:1788940676.165440:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788940676.165444:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2cf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.165451:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd2cf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788940676.165636:0:6520:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788940676.165670:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+7:10549:x1875839921709184:12345-192.168.202.25@tcp:36:chown.0 Request processed in 6834us (7569us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788940676.165679:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 28 00010000:00010000:3.0:1788940676.166962:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd300 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.166977:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd300 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.166997:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd300 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.167003:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c0e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940676.167008:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd300 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.167016:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd300 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.167031:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:3.0:1788940676.167034:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788940676.167039:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd300 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.167045:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd300 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940676.189611:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940676.195226:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921709312 00000100:00100000:2.0:1788940676.195241:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921709312 00000100:00100000:2.0:1788940676.195326:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:2.0:1788940676.195337:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+6:10550:x1875839921709312:12345-192.168.202.25@tcp:101:touch.500 00010000:00010000:2.0:1788940676.195373:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940676.195393:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd307 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc71f0 expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788940676.198460:0:9713:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3014us 00010000:00010000:3.0:1788940676.219976:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd30e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220011:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd30e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220027:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd30e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220045:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd315 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220052:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd315 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220500:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd315 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220749:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0800/0x9c34acc08badd31c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220759:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0800/0x9c34acc08badd31c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220767:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0800/0x9c34acc08badd31c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940676.220807:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788940676.220811:0:9713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940676.220865:0:9713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0800/0x9c34acc08badd31c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220880:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd30e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220887:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd30e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220895:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd30e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220902:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c0e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940676.220908:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd30e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220917:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd30e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220941:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65400) 00010000:00010000:3.0:1788940676.220945:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940676.220952:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd30e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220959:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd30e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220975:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd315 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220982:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd315 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220988:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd315 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.220993:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c0200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940676.220996:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd315 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.221003:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd315 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.221010:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91cf07e65f00) 00010000:00010000:3.0:1788940676.221013:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940676.221016:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd315 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.221021:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd315 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.224950:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd307 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71f0 expref: 8 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.224990:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0800/0x9c34acc08badd31c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71f0 expref: 7 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.225000:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91cf07e65d00) 00010000:00010000:3.0:1788940676.225003:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788940676.225008:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0421c0800, rc 0) 00000100:00100000:3.0:1788940676.225187:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+7:10550:x1875839921709312:12345-192.168.202.25@tcp:101:touch.500 Request processed in 29848us (35584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940676.225199:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:2.0:1788940676.232462:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940676.232837:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921709568 00000100:00100000:1.0:1788940676.232853:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921709568 00000100:00100000:1.0:1788940676.232937:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:1.0:1788940676.232951:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+7:10550:x1875839921709568:12345-192.168.202.25@tcp:101:touch.500 00010000:00010000:1.0:1788940676.232982:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940676.233010:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab600/0x9c34acc08badd323 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc71f7 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.233176:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd32a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.233194:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd32a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.233209:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd32a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.235744:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa600/0x9c34acc08badd331 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.235792:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa600/0x9c34acc08badd331 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.235806:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa600/0x9c34acc08badd331 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788940676.236311:0:8517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788940676.236497:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd338 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.236508:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd338 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.236516:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd338 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.239753:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd32a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.239767:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd32a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.239774:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd32a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.239780:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaaa800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940676.239784:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd32a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.239792:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd32a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.240434:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91cf07e65d00) 00010000:00010000:1.0:1788940676.240437:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940676.240444:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd32a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.240451:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd32a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940676.240474:0:8517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008478e8c6 reply state 00000000e4e3c31f transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa600/0x9c34acc08badd331 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.240486:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa600/0x9c34acc08badd331 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.240493:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xdf2201b3 (ffff91cf06dfae00) 00010000:00010000:1.0:1788940676.240496:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788940676.240499:0:8517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788940676.241707:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab600/0x9c34acc08badd323 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71f7 expref: 10 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.241732:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd338 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71f7 expref: 9 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.241740:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff91cf06dfa200) 00010000:00010000:1.0:1788940676.241743:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940676.241746:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaab000, rc 0) 00000100:00100000:1.0:1788940676.241854:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+10:10550:x1875839921709568:12345-192.168.202.25@tcp:101:touch.500 Request processed in 8905us (9408us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788940676.241877:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:1.0:1788940676.245460:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940676.245546:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921709824 00000100:00100000:0.0:1788940676.245564:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921709824 00000100:00100000:0.0:1788940676.245654:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:0.0:1788940676.245666:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+10:10550:x1875839921709824:12345-192.168.202.25@tcp:36:touch.500 00010000:00010000:0.0:1788940676.245748:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940676.245787:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd338 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71f7 expref: 10 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.245811:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff91cf06dfa200) 00010000:00010000:0.0:1788940676.245826:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940676.245906:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd346 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.246385:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd346 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.246411:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd346 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940676.246582:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000839d1abd reply state 000000005015fc4b transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd346 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.246598:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd346 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.246626:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:0.0:1788940676.246629:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788940676.246632:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940676.246824:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+11:10550:x1875839921709824:12345-192.168.202.25@tcp:36:touch.500 Request processed in 1157us (1372us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788940676.246834:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:0.0:1788940676.250949:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940676.251236:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921709952 00000100:00100000:3.0:1788940676.251251:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921709952 00000100:00100000:3.0:1788940676.251380:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 32 00000100:00100000:3.0:1788940676.251636:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+11:10550:x1875839921709952:12345-192.168.202.25@tcp:101:touch.500 00010000:00010000:3.0:1788940676.251677:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940676.251706:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd34d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc71fe expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.251788:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd34d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71fe expref: 12 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.251807:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd34d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71fe expref: 12 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.251859:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:3.0:1788940676.251863:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940676.251868:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0421c0200, rc 0) 00000100:00100000:3.0:1788940676.251974:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+12:10550:x1875839921709952:12345-192.168.202.25@tcp:101:touch.500 Request processed in 575us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940676.251982:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 32 00000100:00100000:2.0:1788940676.256053:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940676.256397:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921710080 00000100:00100000:3.0:1788940676.256413:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921710080 00000100:00100000:3.0:1788940676.256479:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:3.0:1788940676.256490:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1875839921710080:12345-192.168.202.25@tcp:8:touch.500 00010000:00080000:3.0:1788940676.256538:0:8438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp t0 exp 0000000000000000 cur 431 last 0 00000020:00000080:3.0:1788940676.256590:0:8438:0:(genops.c:1393:class_connect()) connect: client 82f3b232-46da-4a78-8599-45df2ddbced0, cookie 0x9c34acc08badd354 00002000:00100000:3.0:1788940676.256610:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 82f3b232-46da-4a78-8599-45df2ddbced0/ffff91d035a19000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788940676.256627:0:8438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:3.0:1788940676.256742:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788940676.256787:0:8438:0:(import.c:65:import_set_state_nolock()) ffff91d035a1f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940676.256886:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+6:2403:x1875839921710080:12345-192.168.202.25@tcp:8:touch.500 Request processed in 396us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940676.256895:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:2.0:1788940676.260921:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940676.261150:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921710208 00000100:00100000:3.0:1788940676.261165:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921710208 00000100:00080000:2.0:1788940676.261416:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940676.261439:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:2.0:1788940676.261455:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:0:x1875839921710208:12345-192.168.202.25@tcp:2:touch.500 00000001:00080000:1.0:1788940676.280934:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:1.0:1788940676.280960:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 82f3b232-46da-4a78-8599-45df2ddbced0 00000100:00100000:2.0:1788940676.281302:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:0:x1875839921710208:12345-192.168.202.25@tcp:2:touch.500 Request processed in 19844us (20405us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788940676.281317:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:0.0:1788940676.283978:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940676.284167:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921710464 00000100:00100000:3.0:1788940676.284181:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921710464 00000100:00100000:3.0:1788940676.284313:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:3.0:1788940676.284327:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+12:10550:x1875839921710464:12345-192.168.202.25@tcp:35:touch.500 00000100:00100000:3.0:1788940676.284811:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+13:10550:x1875839921710464:12345-192.168.202.25@tcp:35:touch.500 Request processed in 486us (845us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788940676.284821:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:0.0:1788940676.294850:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940676.295174:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921710592 00000100:00100000:1.0:1788940676.295191:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921710592 00000100:00100000:1.0:1788940676.295373:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:1.0:1788940676.295386:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+13:10551:x1875839921710592:12345-192.168.202.25@tcp:101:rm.0 00010000:00010000:1.0:1788940676.295422:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940676.295448:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd35b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7205 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.295547:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab600/0x9c34acc08badd362 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.295565:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab600/0x9c34acc08badd362 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.295581:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab600/0x9c34acc08badd362 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940676.295645:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788940676.295649:0:8517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788940676.295699:0:8517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab600/0x9c34acc08badd362 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.295736:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd35b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7205 expref: 15 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.295759:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab600/0x9c34acc08badd362 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7205 expref: 14 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.295792:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91cf07e65d00) 00010000:00010000:1.0:1788940676.295795:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940676.295800:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02eaab600, rc 0) 00000100:00100000:1.0:1788940676.295877:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+14:10551:x1875839921710592:12345-192.168.202.25@tcp:101:rm.0 Request processed in 493us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940676.295886:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:2.0:1788940676.299889:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940676.300190:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921710848 00000100:00100000:0.0:1788940676.300207:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921710848 00000100:00100000:3.0:1788940676.300626:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00100000:3.0:1788940676.300644:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+14:10551:x1875839921710848:12345-192.168.202.25@tcp:101:rm.0 00010000:00010000:3.0:1788940676.300675:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940676.300704:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd369 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc720c expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940676.300864:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788940676.301045:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd369 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc720c expref: 16 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.301226:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65400) 00010000:00010000:3.0:1788940676.301231:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788940676.301239:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd369 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc720c expref: 16 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.301296:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0421c0e00, rc 0) 00000100:00100000:3.0:1788940676.301404:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+15:10551:x1875839921710848:12345-192.168.202.25@tcp:101:rm.0 Request processed in 765us (1530us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1788940676.301413:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00100000:1.0:1788940676.307465:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940676.307724:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921710976 00000100:00100000:3.0:1788940676.307738:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921710976 00000100:00100000:3.0:1788940676.307799:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:3.0:1788940676.307808:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+15:10551:x1875839921710976:12345-192.168.202.25@tcp:37:rm.0 00000100:00100000:2.0:1788940676.314575:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+15:10551:x1875839921710976:12345-192.168.202.25@tcp:37:rm.0 Request processed in 6746us (7106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940676.314595:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:2.0:1788940676.318172:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940676.318325:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921711232 00000100:00100000:3.0:1788940676.318351:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921711232 00000100:00100000:3.0:1788940676.318438:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:3.0:1788940676.318454:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d002e65450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+15:10551:x1875839921711232:12345-192.168.202.25@tcp:35:rm.0 00000100:00100000:3.0:1788940676.318804:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d002e65450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+16:10551:x1875839921711232:12345-192.168.202.25@tcp:35:rm.0 Request processed in 353us (646us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788940676.318814:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:1.0:1788940676.322204:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940676.322498:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921711488 00000100:00100000:0.0:1788940676.322515:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921711488 00000100:00100000:0.0:1788940676.322609:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 35 00000100:00100000:0.0:1788940676.322622:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+16:10551:x1875839921711488:12345-192.168.202.25@tcp:101:rm.0 00010000:00010000:0.0:1788940676.322657:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940676.322685:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d600/0x9c34acc08badd377 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7213 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.322834:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd37e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.322854:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd37e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.322869:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd37e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940676.322883:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788940676.323446:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d600/0x9c34acc08badd377 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7213 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.323469:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd37e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7213 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.323478:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91cf07e65d00) 00010000:00010000:0.0:1788940676.323482:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788940676.323488:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584ca00, rc 0) 00000100:00100000:0.0:1788940676.323843:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+18:10551:x1875839921711488:12345-192.168.202.25@tcp:101:rm.0 Request processed in 1219us (1649us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788940676.323855:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 35 00000100:00100000:0.0:1788940676.327597:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940676.327712:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921711616 00000100:00100000:1.0:1788940676.327728:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921711616 00000100:00100000:1.0:1788940676.327844:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:1.0:1788940676.327857:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+18:10551:x1875839921711616:12345-192.168.202.25@tcp:41:rm.0 00000004:00000024:1.0:1788940676.327948:0:8517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1788940676.328057:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+18:10551:x1875839921711616:12345-192.168.202.25@tcp:41:rm.0 Request processed in 202us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940676.328475:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:2.0:1788940676.331229:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940676.331456:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921711744 00000100:00100000:3.0:1788940676.331470:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921711744 00000100:00100000:3.0:1788940676.331584:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 37 00000100:00100000:3.0:1788940676.331597:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+18:10551:x1875839921711744:12345-192.168.202.25@tcp:101:rm.0 00010000:00010000:3.0:1788940676.331626:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940676.331654:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd38c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc721a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.331746:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c1200/0x9c34acc08badd393 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.331766:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c1200/0x9c34acc08badd393 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.331781:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c1200/0x9c34acc08badd393 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.331793:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0a00/0x9c34acc08badd39a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.331801:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0a00/0x9c34acc08badd39a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.331829:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0a00/0x9c34acc08badd39a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.332053:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badd3a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.332225:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badd3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.332236:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badd3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940676.332324:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788940676.332331:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940676.332373:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badd3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.332388:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badd3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.332396:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c1200/0x9c34acc08badd393 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.332403:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c1200/0x9c34acc08badd393 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.332411:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c1200/0x9c34acc08badd393 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.332418:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c1200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940676.332423:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c1200/0x9c34acc08badd393 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.333572:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c1200/0x9c34acc08badd393 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.333593:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91cf07e65d00) 00010000:00010000:3.0:1788940676.333596:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940676.333604:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c1200/0x9c34acc08badd393 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.333612:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c1200/0x9c34acc08badd393 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.333636:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0a00/0x9c34acc08badd39a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.333643:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0a00/0x9c34acc08badd39a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.333649:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0a00/0x9c34acc08badd39a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.333655:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c0a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940676.333658:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0a00/0x9c34acc08badd39a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.333664:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0a00/0x9c34acc08badd39a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.333671:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xdf2201b3 (ffff91cf06dfae00) 00010000:00010000:3.0:1788940676.333675:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940676.333678:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0a00/0x9c34acc08badd39a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.333701:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0a00/0x9c34acc08badd39a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.333755:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0e00/0x9c34acc08badd38c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc721a expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.333771:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badd3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc721a expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940676.333779:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:3.0:1788940676.333781:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940676.333784:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936000, rc 0) 00000100:00100000:3.0:1788940676.334507:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+19:10551:x1875839921711744:12345-192.168.202.25@tcp:101:rm.0 Request processed in 2905us (3286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940676.334521:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 37 00000100:00100000:0.0:1788940676.338087:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940676.338185:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921712000 00000100:00100000:1.0:1788940676.338200:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921712000 00000100:00100000:1.0:1788940676.338307:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 38 00000100:00100000:1.0:1788940676.338321:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+19:10551:x1875839921712000:12345-192.168.202.25@tcp:36:rm.0 00010000:00010000:1.0:1788940676.338422:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788940676.338465:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badd3a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc721a expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.338494:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0200/0x9c34acc08badd34d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71fe expref: 18 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.338530:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:1.0:1788940676.338545:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab600/0x9c34acc08badd362 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7205 expref: 17 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.338554:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91cf07e65d00) 00010000:00010000:1.0:1788940676.338558:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940676.338589:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd3a8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.338607:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd3a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.338619:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd3a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.338632:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd3af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.338639:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd3af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.338645:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd3af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.338774:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052000/0x9c34acc08badd3b6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.338785:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052000/0x9c34acc08badd3b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.338803:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052000/0x9c34acc08badd3b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940676.339129:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788940676.339142:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 431671883937ns, next at 432671880762ns, rc = 0 00010000:00010000:1.0:1788940676.339204:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08badd3bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339213:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08badd3bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339222:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08badd3bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339231:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08badd3bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339239:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08badd3bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339247:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08badd3bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339326:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940676.339367:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052000/0x9c34acc08badd3b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339375:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052000/0x9c34acc08badd3b6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339381:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052000/0x9c34acc08badd3b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339397:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042052000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940676.339403:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052000/0x9c34acc08badd3b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339412:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052000/0x9c34acc08badd3b6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339423:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:1.0:1788940676.339426:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788940676.339431:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052000/0x9c34acc08badd3b6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339438:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052000/0x9c34acc08badd3b6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339461:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd3a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339468:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd3a8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339475:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd3a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339479:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaab000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940676.339482:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd3a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339488:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd3a8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339508:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91cf07e65d00) 00010000:00010000:1.0:1788940676.339510:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940676.339514:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd3a8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339520:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaab000/0x9c34acc08badd3a8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940676.339532:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004044c232 reply state 00000000452d3283 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd3af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339546:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd3af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.339553:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xdf2201b3 (ffff91cf06dfae00) 00010000:00010000:1.0:1788940676.339555:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788940676.339559:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940676.339686:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+18:10551:x1875839921712000:12345-192.168.202.25@tcp:36:rm.0 Request processed in 1365us (1621us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788940676.339696:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 38 00010000:00010000:0.0:1788940676.339921:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940676.339930:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08badd3bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.339937:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042053a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940676.339941:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08badd3bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.339948:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08badd3bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.339958:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:0.0:1788940676.339961:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788940676.339964:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08badd3bd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.339982:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08badd3bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940676.339994:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940676.339996:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940676.339997:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940676.343227:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940676.343448:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921712256 00000100:00100000:3.0:1788940676.343462:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921712256 00000100:00100000:3.0:1788940676.343546:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:3.0:1788940676.343559:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+18:10551:x1875839921712256:12345-192.168.202.25@tcp:35:rm.0 00000100:00100000:3.0:1788940676.343877:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+19:10551:x1875839921712256:12345-192.168.202.25@tcp:35:rm.0 Request processed in 319us (664us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788940676.343887:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:0.0:1788940676.347149:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940676.347247:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921712512 00000100:00100000:1.0:1788940676.347418:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921712512 00000100:00100000:1.0:1788940676.347532:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00100000:1.0:1788940676.347546:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+19:10551:x1875839921712512:12345-192.168.202.25@tcp:36:rm.0 00010000:00010000:1.0:1788940676.347646:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788940676.347686:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd37e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7213 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.347738:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0421c0800/0x9c34acc08badd31c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71f0 expref: 18 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.347753:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91cf07e65d00) 00010000:00010000:1.0:1788940676.347773:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd2dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71e2 expref: 17 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.347782:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65400) 00010000:00010000:1.0:1788940676.347788:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940676.347824:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd3c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.347840:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd3c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.347852:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd3c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.347867:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd3cb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.347875:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd3cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.347881:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd3cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.348023:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd3d2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.348042:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd3d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.348049:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd3d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940676.348448:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788940676.348469:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd3d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.348478:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd3d2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.348486:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd3d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.348494:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940676.348499:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd3d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.348508:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd3d2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.348516:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91cf06dfa900) 00010000:00010000:1.0:1788940676.348519:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788940676.348524:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd3d2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.348530:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd3d2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.348552:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd3c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.348566:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd3c4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.348571:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd3c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.348576:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940676.348579:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd3c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.348585:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd3c4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.348593:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfab00) 00010000:00010000:1.0:1788940676.348595:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940676.348599:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd3c4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.348604:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd3c4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940676.348617:0:8517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000069059d0 reply state 000000005fa11705 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd3cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.348628:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd3cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940676.348634:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91cf06dfa600) 00010000:00010000:1.0:1788940676.348636:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788940676.348640:0:8517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940676.348991:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+18:10551:x1875839921712512:12345-192.168.202.25@tcp:36:rm.0 Request processed in 1444us (1853us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788940676.349010:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 39 00010000:00010000:0.0:1788940676.381355:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940676.763683:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944875904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788940676.763800:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940676.764400:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944875904 00000100:00100000:2.0:1788940676.764413:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944875904 00000100:00100000:2.0:1788940676.764500:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788940676.764511:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944875904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940676.764561:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940676.764633:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944875904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940676.764641:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788940676.764790:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944875904:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788940677.404676:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940677.787463:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940677.787487:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944876032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788940677.787578:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940677.787665:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944876032 00000100:00100000:1.0:1788940677.787673:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944876032 00000100:00100000:1.0:1788940677.787742:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788940677.787755:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944876032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788940677.787788:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940677.787837:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944876032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940677.787845:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:1.0:1788940677.787871:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788940677.787908:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf0852dc00 x1875839944876032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940677.787930:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944876032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940677.788323:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944876288:0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.788368:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940677.788390:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944876800:0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.788408:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940677.788420:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944877312:0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.788436:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940677.788457:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788940677.788462:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944876160:0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.788485:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940677.788499:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944876672:0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.788518:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940677.788534:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944877184:0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.788555:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940677.788574:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944876544:0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.788594:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940677.788614:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944877056:0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.788635:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940677.788773:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944877568:0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.788811:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940677.788830:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788940677.788835:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944876416:0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.788856:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940677.788871:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944876928:0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.788891:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940677.788910:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944877440:0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.788932:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940677.788951:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944876288 00000100:00100000:2.0:1788940677.788955:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944876288 00000100:00100000:2.0:1788940677.788980:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944876800 00000100:00100000:2.0:1788940677.788982:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944876800 00000100:00100000:2.0:1788940677.788997:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944877312 00000100:00100000:2.0:1788940677.788999:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944877312 00000100:00100000:2.0:1788940677.789010:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944876544 00000100:00100000:2.0:1788940677.789012:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944876544 00000100:00100000:2.0:1788940677.789020:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944876928 00000100:00100000:2.0:1788940677.789022:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944876928 00000100:00100000:2.0:1788940677.789033:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944877440 00000100:00100000:2.0:1788940677.789035:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944877440 00000100:00100000:2.0:1788940677.789379:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788940677.789390:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944876288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.789429:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944876288:12345-0@lo:400:kworker.0 Request processed in 42us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940677.789468:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944877696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940677.789495:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940677.789521:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944877696 00000100:00100000:0.0:1788940677.789524:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944877696 00000100:00100000:0.0:1788940677.789548:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788940677.789554:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944877696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940677.789566:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940677.789594:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944877696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940677.789600:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:0.0:1788940677.789633:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf0852dc00 x1875839944877696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940677.789647:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944877696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940677.792466:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788940677.792507:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944876800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940677.793408:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788940677.793434:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944877312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940677.793464:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944876800:12345-0@lo:400:kworker.0 Request processed in 979us (5051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940677.793477:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788940677.793536:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788940677.793549:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944876544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940677.793573:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944877312:12345-0@lo:400:kworker.0 Request processed in 148us (5131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940677.793584:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788940677.793624:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944876544:12345-0@lo:400:kworker.0 Request processed in 76us (5024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940677.793626:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788940677.793640:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788940677.793646:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944876928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940677.793667:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788940677.793681:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944877440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940677.793743:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944877440:12345-0@lo:400:kworker.0 Request processed in 67us (4811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940677.793749:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788940677.795010:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944876288:0@lo:400:kworker.0 00000100:00100000:1.0:1788940677.795035:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944876800:0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.795152:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788940677.795201:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944876672 00000100:00100000:2.0:1788940677.795221:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944876672 00000100:00100000:2.0:1788940677.795304:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944876416 00000100:00100000:2.0:1788940677.795308:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944876416 00000100:00100000:2.0:1788940677.795354:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788940677.795365:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944876672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.795460:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944876672:12345-0@lo:400:kworker.0 Request processed in 97us (6939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940677.795469:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788940677.795484:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788940677.795490:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944876416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.795525:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944876416:12345-0@lo:400:kworker.0 Request processed in 36us (6668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940677.795530:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788940677.795557:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944877184 00000100:00100000:2.0:1788940677.795561:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944877184 00000100:00100000:2.0:1788940677.795606:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944877056 00000100:00100000:2.0:1788940677.795611:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944877056 00000100:00100000:2.0:1788940677.795631:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944877568 00000100:00100000:2.0:1788940677.795634:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944877568 00000100:00100000:2.0:1788940677.800182:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788940677.800210:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944877184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.800362:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944877184:12345-0@lo:400:kworker.0 Request processed in 166us (11804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940677.800370:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788940677.800401:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788940677.800408:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944877056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.800440:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944877056:12345-0@lo:400:kworker.0 Request processed in 33us (11804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940677.800446:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788940677.800457:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788940677.800471:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944877568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.800501:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944877568:12345-0@lo:400:kworker.0 Request processed in 31us (11690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940677.800506:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788940677.800590:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944876416:0@lo:400:kworker.0 00010000:00080000:2.0:1788940677.800609:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ee1500 x1875839944876928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940677.800620:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944876928:0@lo:400:kworker.0 00010000:00080000:2.0:1788940677.800632:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f67100 x1875839944877440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940677.800640:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944877440:0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.800666:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944876544:0@lo:400:kworker.0 00010000:00080000:2.0:1788940677.800680:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf079e9500 x1875839944877056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940677.800688:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944877056:0@lo:400:kworker.0 00010000:00080000:2.0:1788940677.800699:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f66a00 x1875839944877568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940677.800708:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944877568:0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.804996:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944876160 00000100:00100000:2.0:1788940677.805014:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944876160 00000100:00100000:2.0:1788940677.805103:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788940677.805114:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944876160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940677.805250:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944876160:12345-0@lo:400:kworker.0 Request processed in 137us (16762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940677.805275:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788940677.805555:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944877312:0@lo:400:kworker.0 00000100:00100000:1.0:1788940677.805616:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944876160:0@lo:400:kworker.0 00000100:00100000:1.0:1788940677.805633:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944876672:0@lo:400:kworker.0 00010000:00080000:1.0:1788940677.805666:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf079e8e00 x1875839944877184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940677.805687:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944877184:0@lo:400:kworker.0 00000100:00080000:1.0:1788940677.805734:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940677.805740:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940677.805744:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940677.805746:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940677.808975:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944876928:12345-0@lo:400:kworker.0 Request processed in 15322us (20069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940677.808992:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00010000:00010000:0.0:1788940678.430193:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940679.451568:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940680.347526:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940680.347550:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944877824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940680.347640:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940680.348042:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944877824 00000100:00100000:2.0:1788940680.348052:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944877824 00000100:00100000:2.0:1788940680.348147:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788940680.348158:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944877824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940680.348193:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788940680.348284:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944877824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940680.348292:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788940680.348397:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944877824:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788940680.478349:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940680.490017:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940680.490073:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940680.490109:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940680.490135:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940680.490159:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940680.490181:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940680.490209:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921712896 00000100:00100000:1.0:1788940680.490219:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921712896 00000100:00100000:1.0:1788940680.490289:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921713152 00000100:00100000:1.0:1788940680.490293:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921713152 00000100:00100000:1.0:1788940680.490320:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921712768 00000100:00100000:1.0:1788940680.490322:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921712768 00000100:00100000:1.0:1788940680.490335:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921713280 00000100:00100000:1.0:1788940680.490338:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921713280 00000100:00100000:1.0:1788940680.490354:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 268 00000100:00100000:1.0:1788940680.490363:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921712896:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940680.490447:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921712896:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 84us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940680.490455:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 268 00000100:00100000:1.0:1788940680.490472:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 269 00000100:00100000:1.0:1788940680.490486:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921713152:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940680.490514:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921713152:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940680.490520:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 269 00000100:00100000:1.0:1788940680.490533:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 270 00000100:00100000:1.0:1788940680.490540:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+18:2405:x1875839921712768:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940680.490567:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+18:2405:x1875839921712768:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 28us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940680.490573:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 270 00000100:00100000:1.0:1788940680.490585:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 271 00000100:00100000:1.0:1788940680.490591:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921713280:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940680.490612:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921713280:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 21us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940680.490617:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 271 00000100:00100000:1.0:1788940680.490638:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921713024 00000100:00100000:1.0:1788940680.490641:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921713024 00000100:00100000:1.0:1788940680.490682:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 103 00000100:00100000:1.0:1788940680.490688:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921713024:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940680.490713:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921713024:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 25us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940680.490720:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 103 00000100:00080000:1.0:1788940680.490742:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940680.490746:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940680.490748:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788940680.491291:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921712640 00000100:00100000:0.0:1788940680.491298:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921712640 00000100:00100000:0.0:1788940680.491345:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 349 00000100:00100000:0.0:1788940680.491353:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2405:x1875839921712640:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940680.491385:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2405:x1875839921712640:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 33us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940680.491391:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 349 00000001:02000400:3.0:1788940680.658506:0:13692:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:1.0:1788940680.861424:0:8523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 436194164518ns, next at 437194161473ns, rc = 0 00000100:00100000:2.0:1788940680.862457:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944877952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940680.862531:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940680.862587:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944877952 00000100:00100000:2.0:1788940680.862592:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940680.862596:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944877952 00000100:00100000:2.0:1788940680.862599:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944878080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788940680.862623:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940680.862645:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944878080 00000100:00100000:1.0:1788940680.862648:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944878080 00000100:00100000:2.0:1788940680.862657:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788940680.862665:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944877952:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940680.862665:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788940680.862670:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944878080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788940680.862695:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1788940680.862695:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940680.862742:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944877952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940680.862751:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788940680.863105:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944878080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 433us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940680.863113:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1788940680.863132:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788940680.867933:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf086fc700 x1875839944878080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940680.867964:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944878080:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788940680.867989:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a2f480 x1875839944877952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940680.868002:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944877952:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1788940681.376675:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788940681.376745:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1788940681.376756:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788940681.377465:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa600/0x9c34acc08badd331 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377480:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa600/0x9c34acc08badd331 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377489:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa600/0x9c34acc08badd331 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377496:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaaa600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940681.377501:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa600/0x9c34acc08badd331 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377511:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa600/0x9c34acc08badd331 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377559:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xdf2201b3 (ffff91cf06dfae00) 00010000:00010000:3.0:1788940681.377563:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940681.377568:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa600/0x9c34acc08badd331 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377575:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa600/0x9c34acc08badd331 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377597:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd346 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377603:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd346 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377609:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd346 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377614:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584d200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940681.377617:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd346 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377623:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd346 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377632:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:3.0:1788940681.377634:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940681.377638:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd346 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377644:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd346 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377672:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd3af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377679:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd3af lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377685:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd3af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377691:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaaa800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940681.377694:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd3af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377700:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd3af lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377708:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xdf2201b3 (ffff91cf06dfae00) 00010000:00010000:3.0:1788940681.377711:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940681.377714:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd3af lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377720:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02eaaa800/0x9c34acc08badd3af lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xdf2201b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377743:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd3cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377748:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd3cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377751:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd3cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377760:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940681.377762:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd3cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377765:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd3cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377771:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91cf06dfa600) 00010000:00010000:3.0:1788940681.377773:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940681.377776:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd3cb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.377782:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd3cb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940681.378311:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944878208:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788940681.378397:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940681.378531:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944878208 00000100:00100000:3.0:1788940681.378540:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944878208 00000100:00100000:3.0:1788940681.378583:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788940681.378592:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944878208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788940681.378619:0:8524:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1788940681.378649:0:8524:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa11184, atime: 0x6aa11184, ctime: 0x6aa11184, blocks: 0x0 00010000:00010000:3.0:1788940681.378655:0:8524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badd3d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.378667:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1788940681.378670:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940681.378675:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badd3d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.378695:0:8524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badd3d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.378702:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badd3d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.378706:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badd3d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.378718:0:8524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788940681.378833:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1875839944878208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 243us (436us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788940681.378838:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788940681.378856:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940681.378861:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badd3d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.378869:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937000 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940681.378872:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badd3d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.378879:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badd3d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.378893:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badd3d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.378907:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badd3d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940681.378921:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940681.378922:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940681.378923:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788940681.379005:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d035a50380/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788940681.379011:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944878208:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788940681.499854:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788940681.824551:0:13740:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdfda23a70 20000000:00000080:3.0:1788940681.824635:0:13740:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91cf085b8400 uarg=0000000000000000 20000000:01000000:3.0:1788940681.824688:0:13740:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788940681.824694:0:13740:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788940681.824700:0:13740:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788940681.825373:0:13741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788940681.825631:0:13740:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788940681.830574:0:13740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788940681.830625:0:13740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788940681.830641:0:13740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788940681.830659:0:13740:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788940681.830678:0:13740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d0355e7800/0x9c34acc08badd3e0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.830696:0:13740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d02eaaa200/0x9c34acc08badd26d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd266 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.830703:0:13740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584c200/0x9c34acc08badd27b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd274 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.830709:0:13740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badd289 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd282 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.830715:0:13740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badd297 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd290 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.830723:0:13740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd29e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71cd expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.830730:0:13740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd2a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71d4 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.830751:0:13740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d0355e7800/0x9c34acc08badd3e0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.830788:0:13740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd2a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71d4 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.830802:0:13740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd2a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71d4 expref: 12 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940681.830826:0:13740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875839944878336:192.168.202.25@tcp:104: 00010000:00010000:2.0:1788940681.830991:0:13740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd29e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71cd expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.831000:0:13740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd29e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71cd expref: 12 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940681.831007:0:13740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875839944878464:192.168.202.25@tcp:104: 00010000:00010000:2.0:1788940681.831083:0:13740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badd297 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badd290 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.831091:0:13740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badd297 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badd290 expref: 23 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940681.831100:0:13740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f66a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875839944878592:0@lo:104: 00000100:00100000:2.0:1788940681.831140:0:13740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788940681.831170:0:13740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badd289 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badd282 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.831187:0:13740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badd289 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badd282 expref: 23 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940681.831195:0:13740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f67100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875839944878720:0@lo:104: 00010000:00010000:2.0:1788940681.831221:0:13740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584c200/0x9c34acc08badd27b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badd274 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.831229:0:13740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584c200/0x9c34acc08badd27b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badd274 expref: 23 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940681.831236:0:13740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875839944878848:0@lo:104: 00010000:00010000:2.0:1788940681.831306:0:13740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d02eaaa200/0x9c34acc08badd26d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badd266 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.831314:0:13740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d02eaaa200/0x9c34acc08badd26d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badd266 expref: 23 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940681.831321:0:13740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875839944878976:0@lo:104: 00000100:00100000:0.0:1788940681.834675:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788940681.834726:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940681.834773:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940681.834785:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940681.834795:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944878592 00000100:00100000:0.0:1788940681.834804:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944878592 00000100:00100000:0.0:1788940681.834877:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944878720 00000100:00100000:0.0:1788940681.834880:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944878720 00000100:00100000:0.0:1788940681.834890:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944878848 00000100:00100000:0.0:1788940681.834892:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944878848 00000100:00100000:0.0:1788940681.834900:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944878976 00000100:00100000:0.0:1788940681.834902:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944878976 00000100:00100000:0.0:1788940681.834913:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788940681.834922:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037855450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+6:13740:x1875839944878592:12345-0@lo:104: 00010000:00010000:0.0:1788940681.834943:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badd290 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd297 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.835012:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788940681.835018:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037855450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+6:13740:x1875839944878592:12345-0@lo:104: Request processed in 97us (3877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940681.835024:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788940681.835060:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788940681.835067:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+5:13740:x1875839944878720:12345-0@lo:104: 00010000:00010000:0.0:1788940681.835074:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08badd282 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.835109:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788940681.835115:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+5:13740:x1875839944878720:12345-0@lo:104: Request processed in 49us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940681.835120:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788940681.835138:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788940681.835145:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:13740:x1875839944878848:12345-0@lo:104: 00010000:00010000:0.0:1788940681.835153:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d0355e6e00/0x9c34acc08badd274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd27b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.835202:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788940681.835208:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+4:13740:x1875839944878848:12345-0@lo:104: Request processed in 64us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940681.835216:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788940681.835235:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788940681.835242:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:13740:x1875839944878976:12345-0@lo:104: 00010000:00010000:0.0:1788940681.835250:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd266 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd26d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.835313:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788940681.835318:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+3:13740:x1875839944878976:12345-0@lo:104: Request processed in 77us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940681.835324:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1788940681.835351:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788940681.835357:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badd290 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd297 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.835364:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaab400 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788940681.835368:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badd290 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badd297 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.835376:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badd290 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badd297 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940681.835383:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badd290 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badd297 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940681.835390:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788940681.835440:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badd290 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd297 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.835447:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788940681.835640:0:13740:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359e2480 going to sleep for 11 seconds 00000100:00100000:2.0:1788940681.835666:0:13740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f66a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875839944878592:0@lo:104: 00000100:00100000:2.0:1788940681.835676:0:13740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f67100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875839944878720:0@lo:104: 00000100:00100000:2.0:1788940681.835683:0:13740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875839944878848:0@lo:104: 00000100:00100000:2.0:1788940681.835690:0:13740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875839944878976:0@lo:104: 00010000:00010000:0.0:1788940681.836378:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badd290 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd297 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.836391:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02eaab400/0x9c34acc08badd290 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd297 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.836405:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788940681.836409:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08badd282 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.836416:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584c800 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788940681.836419:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08badd282 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badd289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.836427:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08badd282 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badd289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940681.836434:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08badd282 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badd289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940681.836440:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788940681.836460:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08badd282 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.836466:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940681.836498:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08badd282 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.836516:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08badd282 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd289 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.836526:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940681.836529:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0355e6e00/0x9c34acc08badd274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd27b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.836535:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6e00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788940681.836538:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e6e00/0x9c34acc08badd274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badd27b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.836544:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0355e6e00/0x9c34acc08badd274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badd27b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940681.836550:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e6e00/0x9c34acc08badd274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badd27b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940681.836556:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788940681.836570:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0355e6e00/0x9c34acc08badd274 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd27b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.836576:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940681.836582:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0355e6e00/0x9c34acc08badd274 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd27b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.836588:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0355e6e00/0x9c34acc08badd274 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd27b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.836596:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940681.836605:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd266 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badd26d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.836611:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584de00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788940681.836614:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd266 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badd26d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.836621:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd266 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badd26d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940681.836628:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd266 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badd26d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940681.836634:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788940681.836647:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd266 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd26d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.836654:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940681.836661:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd266 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd26d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.836668:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badd266 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badd26d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.836682:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940681.836684:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940681.836687:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940681.836695:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940681.836702:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940681.836715:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944879104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940681.836763:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940681.836818:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940681.836825:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944879488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940681.836853:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940681.836883:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944879232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940681.836905:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940681.836925:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940681.836930:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944879360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940681.836949:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940681.836975:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944879104 00000100:00100000:0.0:1788940681.836980:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944879104 00010000:00010000:0.0:1788940681.837004:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badd297 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd290 expref: 24 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940681.837021:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944879488 00000100:00100000:0.0:1788940681.837023:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944879488 00010000:00010000:0.0:1788940681.837032:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d02eaaa200/0x9c34acc08badd26d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd266 expref: 25 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940681.837040:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944879232 00000100:00100000:0.0:1788940681.837042:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944879232 00010000:00010000:0.0:1788940681.837050:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badd289 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd282 expref: 26 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940681.837059:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944879360 00000100:00100000:0.0:1788940681.837062:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944879360 00010000:00010000:0.0:1788940681.837070:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584c200/0x9c34acc08badd27b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd274 expref: 27 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940681.837081:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788940681.837087:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+27:3646:x1875839944879104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940681.837105:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940681.837110:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badd297 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd290 expref: 27 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.837120:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badd297 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badd290 expref: 27 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.837133:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaaa400/0x9c34acc08badd297 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badd290 expref: 27 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.837145:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940681.837364:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+26:3646:x1875839944879104:12345-0@lo:103:ldlm_bl.0 Request processed in 276us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940681.837373:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788940681.837389:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788940681.837395:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+25:3646:x1875839944879488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940681.837403:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940681.837408:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d02eaaa200/0x9c34acc08badd26d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd266 expref: 25 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.837416:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d02eaaa200/0x9c34acc08badd26d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badd266 expref: 25 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.837426:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaaa200/0x9c34acc08badd26d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badd266 expref: 25 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.837434:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940681.837475:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944879488:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940681.837557:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788940681.837572:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788940681.837578:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:3647:x1875839944879232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940681.837585:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940681.837590:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badd289 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd282 expref: 23 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.837597:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badd289 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badd282 expref: 23 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.837606:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaabe00/0x9c34acc08badd289 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badd282 expref: 23 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.837614:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940681.837641:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:3647:x1875839944879232:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940681.837646:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788940681.837658:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788940681.837664:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:3647:x1875839944879360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940681.837671:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940681.837675:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584c200/0x9c34acc08badd27b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badd274 expref: 21 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.837682:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584c200/0x9c34acc08badd27b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badd274 expref: 21 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.837691:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584c200/0x9c34acc08badd27b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badd274 expref: 21 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940681.837710:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940681.837732:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:3647:x1875839944879360:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940681.837737:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788940681.837776:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944879360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940681.837785:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944879232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940681.837821:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944879488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940681.837831:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944879104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940681.844755:0:13740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875839944878336:192.168.202.25@tcp:104: 00000100:00100000:2.0:1788940681.844778:0:13740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13740:1875839944878464:192.168.202.25@tcp:104: 00010000:00010000:2.0:1788940681.844833:0:13740:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d0355e7800/0x9c34acc08badd3e0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940681.846036:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940681.846119:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921713536 00000100:00100000:2.0:1788940681.846134:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921713536 00000100:00100000:0.0:1788940681.846175:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00010000:00010000:2.0:1788940681.846190:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd29e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71cd expref: 13 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940681.847656:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921713408 00000100:00100000:2.0:1788940681.847670:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921713408 00010000:00010000:2.0:1788940681.847707:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd2a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71d4 expref: 14 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940681.847738:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 50 00000100:00100000:2.0:1788940681.847749:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+14:2404:x1875839921713536:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940681.847771:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940681.847777:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd29e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71cd expref: 14 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.847788:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd29e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71cd expref: 14 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.847810:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0421c0c00/0x9c34acc08badd29e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71cd expref: 14 pid: 6512 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.847831:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940681.847912:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2404:x1875839921713536:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 164us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940681.847919:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 50 00000100:00100000:2.0:1788940681.847941:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:2.0:1788940681.847948:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:2404:x1875839921713408:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940681.847987:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940681.847992:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd2a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71d4 expref: 12 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.848006:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd2a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71d4 expref: 12 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.848015:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd2a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc71d4 expref: 12 pid: 6513 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.848027:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d0355e7800/0x9c34acc08badd3e0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.848037:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0355e7800/0x9c34acc08badd3e0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.848056:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d0355e7800/0x9c34acc08badd3e0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.848064:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d0355e7800/0x9c34acc08badd3e0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.848071:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d0355e7800/0x9c34acc08badd3e0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.848078:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d0355e7800/0x9c34acc08badd3e0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.848084:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940681.848088:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d0355e7800/0x9c34acc08badd3e0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.848106:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d0355e7800/0x9c34acc08badd3e0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.848122:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d0355e7800/0x9c34acc08badd3e0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.848134:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940681.848153:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:2404:x1875839921713408:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 206us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940681.848161:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 51 00010000:00010000:2.0:1788940681.848189:0:13740:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d0355e7800/0x9c34acc08badd3e0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.848212:0:13740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d0355e7800/0x9c34acc08badd3e0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940681.848219:0:13740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0355e7800/0x9c34acc08badd3e0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940681.884651:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940681.887562:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944879616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940681.892767:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940681.892928:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944879616 00000100:00100000:2.0:1788940681.892944:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944879616 00000100:00100000:2.0:1788940681.893092:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788940681.893105:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944879616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940681.893166:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940681.893441:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944879616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 335us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940681.893454:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788940681.893549:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944879616:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788940682.534377:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788940682.880931:0:13789:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc15d56700 20000000:00000080:1.0:1788940682.880951:0:13789:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91cf08583800 uarg=0000000000000000 20000000:01000000:1.0:1788940682.881003:0:13789:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1788940682.881010:0:13789:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1788940682.881147:0:13789:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1788940682.882411:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1788940682.882758:0:13789:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1788940682.882842:0:13789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1788940682.882872:0:13789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1788940682.882885:0:13789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1788940682.882897:0:13789:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788940682.882917:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd3e7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940682.882934:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd3e7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940682.882946:0:13789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd3e7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940682.882953:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd3e7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940682.882959:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd3e7 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940682.882967:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd3e7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940682.882973:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940682.882978:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd3e7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940682.882986:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd3e7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940682.883000:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd3e7 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940682.883008:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd3e7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940682.883098:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd3e7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940682.908834:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944879744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940682.909249:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940682.909325:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944879872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940682.909371:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940682.909415:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944880384:0@lo:400:kworker.0 00000100:00100000:1.0:1788940682.909445:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940682.909445:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944880128:0@lo:400:kworker.0 00000100:00100000:1.0:1788940682.909465:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944880896:0@lo:400:kworker.0 00000100:00100000:0.0:1788940682.909469:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940682.909486:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944880640:0@lo:400:kworker.0 00000100:00100000:1.0:1788940682.909488:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940682.909505:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788940682.909507:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940682.909510:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944880256:0@lo:400:kworker.0 00000100:00100000:0.0:1788940682.909520:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944881152:0@lo:400:kworker.0 00000100:00100000:1.0:1788940682.909532:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940682.909537:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940682.909628:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788940682.909635:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944880000:0@lo:400:kworker.0 00000100:00100000:0.0:1788940682.909663:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940682.909665:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944880768:0@lo:400:kworker.0 00000100:00100000:1.0:1788940682.909688:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940682.909692:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944880512:0@lo:400:kworker.0 00000100:00100000:1.0:1788940682.909703:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944881280:0@lo:400:kworker.0 00000100:00100000:0.0:1788940682.909713:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940682.909721:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940682.909729:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944881024:0@lo:400:kworker.0 00000100:00100000:1.0:1788940682.909746:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944879744 00000100:00100000:0.0:1788940682.909748:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940682.909754:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944879744 00000100:00100000:0.0:1788940682.909773:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944880384 00000100:00100000:0.0:1788940682.909777:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944880384 00000100:00100000:0.0:1788940682.909805:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944880128 00000100:00100000:0.0:1788940682.909808:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944880128 00000100:00100000:1.0:1788940682.909820:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944879872 00000100:00100000:1.0:1788940682.909823:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944879872 00000100:00100000:0.0:1788940682.909824:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944880640 00000100:00100000:0.0:1788940682.909826:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944880640 00000100:00100000:0.0:1788940682.909841:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944881152 00000100:00100000:0.0:1788940682.909843:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944881152 00000100:00100000:1.0:1788940682.909844:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788940682.909852:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944879744:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940682.909855:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944880768 00000100:00100000:0.0:1788940682.909857:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944880768 00000100:00100000:0.0:1788940682.909866:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944881280 00000100:00100000:0.0:1788940682.909868:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944881280 00000100:00100000:0.0:1788940682.909879:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00002000:00000024:1.0:1788940682.909883:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940682.909884:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944880384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940682.909922:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944879744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940682.909930:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788940682.909930:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944880384:12345-0@lo:400:kworker.0 Request processed in 42us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940682.909954:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788940682.909962:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944879872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940682.909974:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940682.910196:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944879872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940682.910205:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788940682.910240:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788940682.910248:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944880128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940682.910429:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788940682.910458:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788940682.910469:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944880640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940682.910602:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944880640:12345-0@lo:400:kworker.0 Request processed in 75us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940682.910609:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788940682.910625:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788940682.910632:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944881152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940682.910664:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944880640:0@lo:400:kworker.0 00000100:00100000:0.0:1788940682.910670:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944881152:12345-0@lo:400:kworker.0 Request processed in 40us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940682.910675:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944881152:0@lo:400:kworker.0 00000100:00100000:0.0:1788940682.910677:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788940682.910690:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788940682.910695:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944880768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940682.910720:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944880768:12345-0@lo:400:kworker.0 Request processed in 24us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940682.910726:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788940682.910738:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788940682.910743:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944881280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940682.910767:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944881280:12345-0@lo:400:kworker.0 Request processed in 25us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940682.910772:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788940682.910790:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944880000 00000100:00100000:0.0:1788940682.910794:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944880000 00000100:00100000:0.0:1788940682.910830:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788940682.910836:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:3646:x1875839944880000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940682.910869:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944880128:12345-0@lo:400:kworker.0 Request processed in 622us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940682.910874:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:3646:x1875839944880000:12345-0@lo:400:kworker.0 Request processed in 38us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940682.910875:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788940682.910880:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788940682.910899:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944880896 00000100:00100000:1.0:1788940682.910902:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944880896 00000100:00100000:0.0:1788940682.910905:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944880256 00000100:00100000:0.0:1788940682.910907:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944880256 00000100:00100000:1.0:1788940682.910926:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944881024 00000100:00100000:0.0:1788940682.910926:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944880512 00000100:00100000:1.0:1788940682.910929:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944881024 00000100:00100000:0.0:1788940682.910929:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944880512 00000100:00100000:0.0:1788940682.910940:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788940682.910945:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788940682.910946:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944880256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940682.910950:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944880896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940682.910994:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944880896:12345-0@lo:400:kworker.0 Request processed in 44us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940682.911001:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788940682.911013:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788940682.911464:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944880256:12345-0@lo:400:kworker.0 Request processed in 517us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940682.911471:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788940682.911486:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788940682.911493:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944880512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940682.911519:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944880512:12345-0@lo:400:kworker.0 Request processed in 27us (1805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940682.911525:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788940682.911822:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875839944881024:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788940682.911849:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0042b1f80 x1875839944879744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940682.911856:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875839944881024:12345-0@lo:400:kworker.0 Request processed in 838us (2107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940682.911862:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788940682.911869:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944879744:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788940682.911896:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940682.911902:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940682.911905:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940682.911907:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940682.912924:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944880000:0@lo:400:kworker.0 00000100:00100000:1.0:1788940682.912952:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944880512:0@lo:400:kworker.0 00000100:00100000:1.0:1788940682.912965:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944881024:0@lo:400:kworker.0 00000100:00100000:1.0:1788940682.912975:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944880128:0@lo:400:kworker.0 00000100:00100000:1.0:1788940682.913444:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944880256:0@lo:400:kworker.0 00010000:00080000:1.0:1788940682.913459:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07846a00 x1875839944880768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940682.913469:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944880768:0@lo:400:kworker.0 00010000:00080000:1.0:1788940682.913481:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f5c000 x1875839944881280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940682.913489:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944881280:0@lo:400:kworker.0 00000100:00100000:1.0:1788940682.913502:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944880896:0@lo:400:kworker.0 00000100:00100000:1.0:1788940682.913513:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944880384:0@lo:400:kworker.0 00010000:00080000:1.0:1788940682.913525:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0042b3b80 x1875839944879872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940682.914006:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944879872:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788940683.547690:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940683.753841:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940683.758715:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921713664 00000100:00100000:2.0:1788940683.758743:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921713664 00000100:00100000:2.0:1788940683.758938:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 351 00000100:00100000:2.0:1788940683.758953:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:6193:x1875839921713664:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940683.758979:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940683.759007:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd3ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7221 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940683.759046:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd3ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7221 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940683.759079:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd3ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7221 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940683.759089:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7200, rc 0) 00000100:00100000:2.0:1788940683.759189:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:6193:x1875839921713664:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 Request processed in 239us (5368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940683.759196:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 351 00000100:00100000:1.0:1788940683.766188:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940683.767757:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921713792 00000100:00100000:0.0:1788940683.767778:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921713792 00000100:00100000:0.0:1788940683.767871:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 352 00000100:00100000:0.0:1788940683.767884:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:6193:x1875839921713792:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940683.768331:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:6193:x1875839921713792:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 Request processed in 440us (2153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.768342:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 352 00000100:00100000:1.0:1788940683.773730:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940683.774475:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921713920 00000100:00100000:3.0:1788940683.774503:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921713920 00000100:00100000:3.0:1788940683.774590:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 353 00000100:00100000:3.0:1788940683.774603:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:6193:x1875839921713920:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940683.774846:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:6193:x1875839921713920:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 Request processed in 244us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940683.774857:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 353 00000100:00100000:1.0:1788940683.785662:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940683.786448:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921714048 00000100:00100000:2.0:1788940683.786469:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921714048 00000100:00100000:2.0:1788940683.786568:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 354 00000100:00100000:2.0:1788940683.786604:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:10836:x1875839921714048:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788940683.786821:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:10836:x1875839921714048:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 220us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940683.786833:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 354 00000100:00100000:1.0:1788940683.799205:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 10000000:01000000:1.0:1788940683.808214:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788940683.808253:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d037817800 from 7 10000000:01000000:1.0:1788940683.808303:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940683.808393:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08badd3f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.808410:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08badd3f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.808425:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08badd3f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940683.808465:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08549c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944881408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788940683.808583:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940683.818111:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a4af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940683.822051:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921714176 00000100:00100000:0.0:1788940683.822079:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921714176 00000100:00100000:0.0:1788940683.822201:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944881408 00000100:00100000:0.0:1788940683.822206:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944881408 00000100:00100000:0.0:1788940683.822232:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 355 00000100:00100000:0.0:1788940683.822252:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:10836:x1875839921714176:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940683.822519:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:10836:x1875839921714176:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 276us (23330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.822529:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 355 00000100:00100000:0.0:1788940683.822573:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788940683.822580:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:6517:x1875839944881408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940683.822592:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940683.822615:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584c000/0x9c34acc08badd3fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd3f5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.822647:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584c000/0x9c34acc08badd3fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd3f5 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.822662:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584c000/0x9c34acc08badd3fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd3f5 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.822674:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c000, rc 0) 00000100:00100000:0.0:1788940683.822760:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944881408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (14178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.822766:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788940683.822884:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08549c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944881408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940683.822908:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08badd3f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.822920:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08badd3f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940683.823026:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944881536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940683.823081:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940683.823118:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788940683.823133:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944881536 00000100:00100000:0.0:1788940683.823137:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944881536 00000100:00100000:0.0:1788940683.823160:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788940683.823166:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944881536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940683.823339:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944881536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.823348:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788940683.823380:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944881536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940683.823412:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944881664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940683.823458:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940683.823477:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788940683.823488:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944881664 00000100:00100000:0.0:1788940683.823491:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944881664 00000100:00100000:0.0:1788940683.823508:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788940683.823514:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944881664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940683.823610:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944881664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.823617:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788940683.823661:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944881664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940683.823955:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:13802:1875839944881792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940683.823993:0:13802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940683.824011:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944881792 00000100:00100000:0.0:1788940683.824023:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944881792 00000100:00100000:0.0:1788940683.824041:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788940683.824055:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:13802:x1875839944881792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940683.824141:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:13802:x1875839944881792:12345-0@lo:502:llog_process_th.0 Request processed in 86us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.824148:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788940683.824177:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd300 going to sleep for 11 seconds 00000100:00100000:0.0:1788940683.824189:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:13802:1875839944881792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940683.824211:0:13802:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940683.824224:0:13802:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940683.824226:0:13802:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788940683.824303:0:13802:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d037817800 00000020:00000080:0.0:1788940683.824308:0:13802:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788940683.824380:0:13802:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940683.825835:0:13802:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940683.825846:0:13802:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788940683.825866:0:13802:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940683.825872:0:13802:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940683.825874:0:13802:0:(obd_config.c:1662:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788940683.825881:0:13802:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d037817800 00000020:00000080:1.0:1788940683.825884:0:13802:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788940683.826010:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08549180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:13802:1875839944881920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940683.826095:0:13802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940683.826155:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a4acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940683.827770:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944881920 00000100:00100000:2.0:1788940683.827789:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944881920 00000100:00100000:2.0:1788940683.827916:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788940683.827930:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:13802:x1875839944881920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940683.828384:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:13802:x1875839944881920:12345-0@lo:502:llog_process_th.0 Request processed in 457us (2288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940683.828394:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788940683.837952:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08549180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:13802:1875839944881920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788940683.838015:0:13802:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940683.838032:0:13802:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940683.838036:0:13802:0:(obd_config.c:1662:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788940683.838043:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788940683.840297:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788940683.840357:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788940683.840374:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08badd3f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.840391:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08badd3f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940683.840406:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788940683.840410:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d035758800 from 7 10000000:01000000:0.0:1788940683.840413:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788940683.840465:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badd403 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.840474:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badd403 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.840499:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badd403 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940683.840531:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944882048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940683.840634:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940683.840697:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940683.841170:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944882048 00000100:00100000:1.0:1788940683.841181:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944882048 00000100:00100000:1.0:1788940683.841296:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788940683.841309:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:6517:x1875839944882048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940683.841326:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940683.841347:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d004602a00/0x9c34acc08badd40a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd403 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.841378:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d004602a00/0x9c34acc08badd40a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd403 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.841390:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d004602a00/0x9c34acc08badd40a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd403 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.841400:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602a00, rc 0) 00000100:00100000:1.0:1788940683.841453:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944882048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940683.841461:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788940683.845102:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944882048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940683.845142:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badd403 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940683.845158:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badd403 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940683.845310:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944882176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940683.845392:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940683.845452:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd300 going to sleep for 11 seconds 00000100:00100000:0.0:1788940683.845500:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944882176 00000100:00100000:0.0:1788940683.845507:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944882176 00000100:00100000:0.0:1788940683.845566:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788940683.845576:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944882176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940683.845742:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944882176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.845751:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788940683.845802:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944882176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940683.845846:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944882304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940683.845911:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940683.845926:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd300 going to sleep for 11 seconds 00000100:00100000:0.0:1788940683.845938:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944882304 00000100:00100000:0.0:1788940683.845943:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944882304 00000100:00100000:0.0:1788940683.845965:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788940683.845970:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944882304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940683.846052:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944882304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.846059:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788940683.846097:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944882304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940683.846418:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940683.846450:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921714304 00000100:00100000:3.0:1788940683.846458:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921714304 00000100:00100000:0.0:1788940683.846471:0:13805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:13805:1875839944882432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940683.846498:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 364 00000100:00100000:3.0:1788940683.846510:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:6193:x1875839921714304:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940683.846515:0:13805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940683.846537:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944882432 00000100:00100000:0.0:1788940683.846542:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944882432 00010000:00010000:3.0:1788940683.846543:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1788940683.846563:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788940683.846571:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:13805:x1875839944882432:12345-0@lo:502:llog_process_th.0 00010000:00010000:3.0:1788940683.846577:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d035937600/0x9c34acc08badd411 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7228 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940683.846619:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d035937600/0x9c34acc08badd411 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7228 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940683.846634:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d035937600/0x9c34acc08badd411 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7228 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940683.846645:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937600, rc 0) 00000100:00100000:3.0:1788940683.846712:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:6193:x1875839921714304:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 Request processed in 204us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940683.846720:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 364 00000100:00100000:0.0:1788940683.850368:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:13805:x1875839944882432:12345-0@lo:502:llog_process_th.0 Request processed in 3779us (3836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.850394:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788940683.850516:0:13805:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940683.850562:0:13805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:13805:1875839944882432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940683.850614:0:13805:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940683.850629:0:13805:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940683.850633:0:13805:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788940683.850661:0:13805:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d035758800 00000020:00000080:0.0:1788940683.850674:0:13805:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788940683.850753:0:13805:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940683.850757:0:13805:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940683.850759:0:13805:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788940683.850764:0:13805:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940683.850767:0:13805:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940683.850768:0:13805:0:(obd_config.c:1662:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788940683.850773:0:13805:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d035758800 00000020:00000080:0.0:1788940683.850776:0:13805:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788940683.853660:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940683.853719:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921714432 00000100:00100000:3.0:1788940683.853731:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921714432 00000100:00100000:3.0:1788940683.853800:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 366 00000100:00100000:3.0:1788940683.853812:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:6193:x1875839921714432:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940683.854293:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:6193:x1875839921714432:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 Request processed in 443us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940683.854306:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 366 00000100:00100000:0.0:1788940683.855170:0:13805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:13805:1875839944882560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940683.855374:0:13805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940683.855419:0:13805:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940683.855599:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944882560 00000100:00100000:0.0:1788940683.855609:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944882560 00000100:00100000:0.0:1788940683.855987:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788940683.856010:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:13805:x1875839944882560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940683.856178:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:13805:x1875839944882560:12345-0@lo:502:llog_process_th.0 Request processed in 171us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.856187:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788940683.857921:0:13805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:13805:1875839944882560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788940683.857977:0:13805:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940683.859089:0:13805:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940683.859099:0:13805:0:(obd_config.c:1662:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788940683.859117:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788940683.862219:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788940683.862304:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940683.862319:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badd403 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940683.862334:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badd403 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940683.862346:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788940683.862349:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d034739000 from 7 10000000:01000000:2.0:1788940683.862360:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940683.862411:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e7800/0x9c34acc08badd418 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940683.862420:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d0355e7800/0x9c34acc08badd418 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940683.862433:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d0355e7800/0x9c34acc08badd418 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940683.862467:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944882688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940683.862565:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940683.863132:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940683.863791:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0196ea0c0 going to sleep for 11 seconds 00000040:00080000:2.0:1788940683.864462:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788940683.864732:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944882688 00000100:00100000:3.0:1788940683.864744:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944882688 00000100:00100000:3.0:1788940683.864807:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788940683.864819:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+22:6517:x1875839944882688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940683.864856:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940683.864880:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d035937000/0x9c34acc08badd41f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd418 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940683.864931:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d035937000/0x9c34acc08badd41f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd418 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940683.864946:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d035937000/0x9c34acc08badd41f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd418 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940683.864957:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937000, rc 0) 00000100:00100000:3.0:1788940683.865298:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944882688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 480us (2732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940683.865306:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788940683.865362:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944882688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940683.865385:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d0355e7800/0x9c34acc08badd418 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd41f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940683.865397:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d0355e7800/0x9c34acc08badd418 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd41f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940683.865503:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944882816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940683.865550:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940683.865578:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02004f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788940683.865708:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944882816 00000100:00100000:3.0:1788940683.865714:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944882816 00000100:00100000:3.0:1788940683.865739:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788940683.865746:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944882816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940683.865917:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944882816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940683.865925:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788940683.865949:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944882816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940683.865981:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944882944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940683.866353:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940683.866364:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02004f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788940683.866383:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944882944 00000100:00100000:3.0:1788940683.866387:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944882944 00000100:00100000:3.0:1788940683.866405:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788940683.866411:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944882944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940683.866496:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944882944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940683.866503:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788940683.866537:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944882944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940683.868640:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921714560 00000100:00100000:3.0:1788940683.868661:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921714560 00000100:00100000:3.0:1788940683.868727:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 371 00000100:00100000:3.0:1788940683.868739:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:6193:x1875839921714560:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940683.868953:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:6193:x1875839921714560:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 Request processed in 215us (5823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940683.868962:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 371 00000100:00100000:2.0:1788940683.872453:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940683.872503:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921714688 00000100:00100000:2.0:1788940683.872515:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921714688 00000100:00100000:2.0:1788940683.872655:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 372 00000100:00100000:2.0:1788940683.872669:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:10840:x1875839921714688:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788940683.872862:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:10840:x1875839921714688:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 196us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940683.872871:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 372 00000100:00100000:2.0:1788940683.874132:0:13807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:13807:1875839944883072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940683.874218:0:13807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940683.879582:0:13807:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d004f59180 going to sleep for 11 seconds 00000100:00100000:0.0:1788940683.880756:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944883072 00000100:00100000:0.0:1788940683.880774:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944883072 00000100:00100000:0.0:1788940683.881699:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1788940683.881716:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:13807:x1875839944883072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940683.882113:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:13807:x1875839944883072:12345-0@lo:502:llog_process_th.0 Request processed in 401us (7893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.882124:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788940683.882186:0:13807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:13807:1875839944883072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940683.882245:0:13807:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940683.882296:0:13807:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940683.882299:0:13807:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788940683.882309:0:13807:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d034739000 00000020:00000080:3.0:1788940683.882312:0:13807:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788940683.882409:0:13807:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940683.882413:0:13807:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940683.882415:0:13807:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788940683.882418:0:13807:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940683.882421:0:13807:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940683.882422:0:13807:0:(obd_config.c:1662:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788940683.882426:0:13807:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d034739000 00000020:00000080:3.0:1788940683.882429:0:13807:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788940683.882494:0:13807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086ff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:13807:1875839944883200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940683.882555:0:13807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940683.882592:0:13807:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02004fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940683.882688:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944883200 00000100:00100000:0.0:1788940683.882696:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944883200 00000100:00100000:0.0:1788940683.882742:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788940683.882750:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03ec1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:13807:x1875839944883200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940683.883952:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03ec1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:13807:x1875839944883200:12345-0@lo:502:llog_process_th.0 Request processed in 1193us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.883967:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788940683.885056:0:13807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086ff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:13807:1875839944883200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940683.885107:0:13807:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940683.885118:0:13807:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940683.885121:0:13807:0:(obd_config.c:1662:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788940683.885127:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788940683.885354:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788940683.885386:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940683.885400:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e7800/0x9c34acc08badd418 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd41f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940683.885426:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d0355e7800/0x9c34acc08badd418 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd41f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940683.885437:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788940683.885441:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d004f4a000 from 7 10000000:01000000:2.0:1788940683.885444:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940683.885486:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08badd426 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940683.885494:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08badd426 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940683.885506:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08badd426 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940683.885533:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944883328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940683.885955:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940683.887167:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d004f59180 going to sleep for 11 seconds 00000100:00100000:3.0:1788940683.888473:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940683.895220:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944883328 00000100:00100000:3.0:1788940683.895250:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944883328 00000100:00100000:3.0:1788940683.895666:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921714816 00000100:00100000:3.0:1788940683.895672:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921714816 00000100:00100000:3.0:1788940683.895703:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788940683.895717:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:6517:x1875839944883328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940683.895742:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940683.895781:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d035936c00/0x9c34acc08badd42d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badd426 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940683.895821:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d035936c00/0x9c34acc08badd42d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badd426 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940683.895836:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d035936c00/0x9c34acc08badd42d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badd426 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940683.895848:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936c00, rc 0) 00000100:00100000:0.0:1788940683.895850:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 376 00000100:00100000:0.0:1788940683.895880:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:10840:x1875839921714816:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788940683.895960:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944883328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 246us (10005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940683.895981:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788940683.896170:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:10840:x1875839921714816:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 308us (7707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.896177:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 376 00000100:00100000:1.0:1788940683.896346:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944883328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940683.896371:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08badd426 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd42d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.896384:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08badd426 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd42d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940683.896485:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08549180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944883456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940683.896533:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940683.896696:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a4a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940683.896773:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944883456 00000100:00100000:0.0:1788940683.896779:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944883456 00000100:00100000:0.0:1788940683.896822:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788940683.896830:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944883456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940683.896946:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944883456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.896954:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788940683.897837:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08549180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944883456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940683.897910:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08549180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944883584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940683.897972:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940683.898076:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a4a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788940683.898098:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944883584 00000100:00100000:1.0:1788940683.898104:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944883584 00000040:00080000:0.0:1788940683.898127:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788940683.898142:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788940683.898149:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944883584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940683.898284:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:6517:x1875839944883584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940683.898293:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788940683.898294:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08549180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf4e294e-c65c-4988-a227-6e2e705a91d9:6517:1875839944883584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940683.900496:0:13810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08549180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:13810:1875839944883712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940683.900744:0:13810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940683.900849:0:13810:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0358d8600 going to sleep for 11 seconds 00000100:00100000:0.0:1788940683.900890:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944883712 00000100:00100000:0.0:1788940683.900900:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944883712 00000100:00100000:0.0:1788940683.901066:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788940683.901080:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:13810:x1875839944883712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940683.901243:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:13810:x1875839944883712:12345-0@lo:502:llog_process_th.0 Request processed in 166us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.901250:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1788940683.901407:0:13810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08549180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:13810:1875839944883712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788940683.901443:0:13810:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940683.901456:0:13810:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940683.901459:0:13810:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788940683.901467:0:13810:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d004f4a000 00000020:00000080:1.0:1788940683.901470:0:13810:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788940683.901529:0:13810:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940683.901866:0:13810:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940683.901869:0:13810:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788940683.901873:0:13810:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940683.901877:0:13810:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940683.901878:0:13810:0:(obd_config.c:1662:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788940683.901882:0:13810:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d004f4a000 00000020:00000080:1.0:1788940683.901884:0:13810:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788940683.901959:0:13810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08549180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:13810:1875839944883840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940683.902084:0:13810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940683.902115:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944883840 00000100:00100000:1.0:1788940683.902121:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944883840 00000100:00100000:1.0:1788940683.902157:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788940683.902164:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:13810:x1875839944883840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940683.902291:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:13810:x1875839944883840:12345-0@lo:502:llog_process_th.0 Request processed in 92us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940683.902300:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788940683.902341:0:13810:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0358d8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788940683.902357:0:13810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08549180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf4e294e-c65c-4988-a227-6e2e705a91d9:13810:1875839944883840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788940683.902377:0:13810:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940683.902381:0:13810:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940683.902383:0:13810:0:(obd_config.c:1662:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788940683.902387:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788940683.902492:0:6517:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788940683.902524:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940683.902537:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08badd426 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd42d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940683.902908:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08badd426 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd42d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940684.578786:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788940684.893136:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788940684.956151:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788940685.467955:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940685.468008:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944883968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940685.468110:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940685.468308:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944883968 00000100:00100000:2.0:1788940685.468318:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944883968 00000100:00100000:2.0:1788940685.468389:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788940685.468401:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944883968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940685.468446:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788940685.468523:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944883968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940685.468532:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788940685.468666:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944883968:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788940685.595615:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940685.609935:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940685.610038:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940685.610070:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940685.610209:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921714944 00000100:00100000:2.0:1788940685.610233:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921714944 00000100:00100000:2.0:1788940685.610316:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 381 00000100:00100000:2.0:1788940685.610327:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921714944:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940685.610420:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921714944:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 94us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940685.610428:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 381 00000100:00100000:1.0:1788940685.610630:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940685.621240:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940685.621333:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940685.628351:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921715200 00000100:00100000:0.0:1788940685.628353:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921715456 00000100:00100000:3.0:1788940685.628381:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921715200 00000100:00100000:0.0:1788940685.628381:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921715456 00000100:00100000:0.0:1788940685.628523:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921715072 00000100:00100000:0.0:1788940685.628529:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921715072 00000100:00100000:3.0:1788940685.637551:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921715584 00000100:00100000:3.0:1788940685.637568:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921715584 00000100:00100000:3.0:1788940685.637605:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 278 00000100:00100000:3.0:1788940685.637616:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921715456:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940685.637731:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921715456:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 116us (27658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940685.637739:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 278 00000100:00100000:3.0:1788940685.637934:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 279 00000100:00100000:3.0:1788940685.637942:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921715200:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940685.637972:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921715200:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 31us (27933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940685.637978:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 279 00000100:00100000:3.0:1788940685.637994:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 280 00000100:00100000:3.0:1788940685.638016:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921715584:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940685.638045:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921715584:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 29us (16711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940685.638050:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 280 00000100:00100000:3.0:1788940685.638241:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921715328 00000100:00100000:3.0:1788940685.638246:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921715328 00000100:00100000:3.0:1788940685.638524:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 106 00000100:00100000:3.0:1788940685.638532:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921715328:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940685.638576:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921715328:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 45us (17348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940685.638583:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 106 00000100:00100000:0.0:1788940685.641681:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 281 00000100:00100000:0.0:1788940685.641704:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921715072:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940685.641837:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921715072:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 140us (31206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940685.641846:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 281 00000100:00080000:1.0:1788940685.645627:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940685.645872:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940685.645876:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940685.981542:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944884096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788940685.981666:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940685.982202:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944884096 00000100:00100000:3.0:1788940685.982215:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944884096 00000100:00100000:3.0:1788940685.982342:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788940685.982355:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944884096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788940685.982397:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940685.982460:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944884096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940685.982468:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788940685.982867:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944884096:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788940685.982901:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940685.984177:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944884224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940685.984298:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940685.984387:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944884224 00000100:00100000:3.0:1788940685.984400:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944884224 00000100:00100000:3.0:1788940685.984490:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788940685.984501:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875839944884224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940685.984530:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788940685.984800:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940685.984866:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875839944884224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 366us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940685.984896:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788940685.985003:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944884224:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788940686.619583:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940687.003898:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944884352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788940687.003976:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940687.004054:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944884352 00000100:00100000:2.0:1788940687.004063:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944884352 00000100:00100000:2.0:1788940687.004437:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788940687.004452:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944884352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940687.004492:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940687.004557:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944884352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940687.004630:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944884352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788940687.014574:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000001:00080000:1.0:1788940687.526092:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:0.0:1788940687.647492:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940688.027663:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944884480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940688.027751:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940688.027853:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944884480 00000100:00100000:2.0:1788940688.027874:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944884480 00000100:00100000:2.0:1788940688.027950:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788940688.027966:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944884480:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940688.027992:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944884736:0@lo:400:kworker.0 00002000:00000024:2.0:1788940688.028000:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940688.028034:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940688.028056:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944884480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940688.028062:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944885248:0@lo:400:kworker.0 00000100:00100000:2.0:1788940688.028076:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788940688.028095:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940688.028105:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944884992:0@lo:400:kworker.0 00000100:00100000:3.0:1788940688.028133:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944885760:0@lo:400:kworker.0 00000100:00100000:0.0:1788940688.028173:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944884864:0@lo:400:kworker.0 00000100:00100000:1.0:1788940688.028242:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944884608:0@lo:400:kworker.0 00000100:00100000:2.0:1788940688.030940:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940688.031010:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944885504:0@lo:400:kworker.0 00000100:00100000:2.0:1788940688.031053:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940688.031078:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944886016:0@lo:400:kworker.0 00000100:00100000:2.0:1788940688.031100:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788940688.031142:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07fd8e00 x1875839944884480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940688.031168:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944884480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940688.031220:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944885504 00000100:00100000:2.0:1788940688.031228:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944885504 00000100:00100000:2.0:1788940688.031311:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944886016 00000100:00100000:2.0:1788940688.031315:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944886016 00000100:00100000:2.0:1788940688.031337:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788940688.031357:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944885504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940688.031406:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944885504:12345-0@lo:400:kworker.0 Request processed in 61us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940688.031490:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788940688.031510:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788940688.031517:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944886016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940688.031626:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944886016:12345-0@lo:400:kworker.0 Request processed in 109us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940688.031632:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788940688.031684:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944885504:0@lo:400:kworker.0 00010000:00080000:2.0:1788940688.031694:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d037870700 x1875839944886016/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940688.031703:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944886016:0@lo:400:kworker.0 00000100:00080000:2.0:1788940688.031725:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940688.031730:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940688.031743:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944884736 00000100:00100000:2.0:1788940688.031746:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944884736 00000100:00100000:2.0:1788940688.031783:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944885248 00000100:00100000:2.0:1788940688.031787:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944885248 00000100:00080000:2.0:1788940688.031801:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940688.031823:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944884992 00000100:00100000:2.0:1788940688.031826:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944884992 00000100:00100000:2.0:1788940688.031842:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788940688.031848:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944884736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940688.031885:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944884736:12345-0@lo:400:kworker.0 Request processed in 36us (3851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940688.031891:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788940688.031903:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788940688.031909:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944885248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940688.031937:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944885248:12345-0@lo:400:kworker.0 Request processed in 28us (3843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940688.031942:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788940688.031951:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788940688.031957:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944884992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940688.031987:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944884992:12345-0@lo:400:kworker.0 Request processed in 30us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940688.031999:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788940688.032025:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944884992:0@lo:400:kworker.0 00000100:00100000:3.0:1788940688.040818:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940688.040894:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944885760 00000100:00100000:2.0:1788940688.040906:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944885760 00000100:00100000:3.0:1788940688.040937:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944884736:0@lo:400:kworker.0 00000100:00100000:3.0:1788940688.040957:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944885248:0@lo:400:kworker.0 00000100:00100000:2.0:1788940688.040983:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788940688.040995:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944885760:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788940688.041025:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940688.041083:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944885760:12345-0@lo:400:kworker.0 Request processed in 89us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940688.041092:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944885760:0@lo:400:kworker.0 00000100:00100000:2.0:1788940688.041093:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788940688.042290:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940688.042337:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944885376:0@lo:400:kworker.0 00000100:00100000:0.0:1788940688.042382:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940688.042528:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944884864 00000100:00100000:2.0:1788940688.042536:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944884864 00000100:00100000:2.0:1788940688.042580:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788940688.042589:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944884864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940688.042619:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944885376 00000100:00100000:3.0:1788940688.042625:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944885376 00000100:00100000:2.0:1788940688.042642:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944884864:12345-0@lo:400:kworker.0 Request processed in 54us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940688.042650:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788940688.042673:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788940688.042684:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944885376:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788940688.042714:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788940688.042726:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944885376:12345-0@lo:400:kworker.0 Request processed in 44us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940688.042734:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788940688.042775:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944885888:0@lo:400:kworker.0 00000100:00100000:0.0:1788940688.042835:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940688.042881:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944884864:0@lo:400:kworker.0 00010000:00080000:0.0:1788940688.042893:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d037870e00 x1875839944885376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940688.042903:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944885376:0@lo:400:kworker.0 00000100:00100000:2.0:1788940688.042967:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944885888 00000100:00100000:2.0:1788940688.042972:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944885888 00000100:00100000:2.0:1788940688.043019:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788940688.043026:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944885888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940688.043062:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944885888:12345-0@lo:400:kworker.0 Request processed in 37us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940688.043068:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:00080000:0.0:1788940688.043140:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d037873100 x1875839944885888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940688.043141:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940688.043154:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944885888:0@lo:400:kworker.0 00000100:00100000:1.0:1788940688.043193:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944885120:0@lo:400:kworker.0 00000100:00100000:1.0:1788940688.043221:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940688.043270:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944885632:0@lo:400:kworker.0 00000100:00100000:0.0:1788940688.043283:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944885120 00000100:00100000:0.0:1788940688.043288:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944885120 00000100:00100000:1.0:1788940688.043300:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940688.043324:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788940688.043327:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944886144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940688.043334:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944885120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940688.043359:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940688.043383:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944885120:12345-0@lo:400:kworker.0 Request processed in 50us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940688.043389:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:3.0:1788940688.043499:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788940688.043518:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944885120:0@lo:400:kworker.0 00000100:00100000:0.0:1788940688.043540:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944885632 00000100:00100000:0.0:1788940688.043550:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944885632 00000100:00100000:2.0:1788940688.043590:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944884608 00000100:00100000:0.0:1788940688.043595:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788940688.043597:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944884608 00000100:00100000:0.0:1788940688.043604:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944885632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940688.043642:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788940688.043656:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944884608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940688.046677:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944886144 00000100:00100000:3.0:1788940688.046696:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944886144 00000100:00100000:3.0:1788940688.046776:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788940688.046788:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944886144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788940688.046818:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788940688.049382:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940688.053253:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944885632:12345-0@lo:400:kworker.0 Request processed in 9628us (9931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940688.053286:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788940688.054577:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944884608:12345-0@lo:400:kworker.0 Request processed in 10921us (11433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940688.054591:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788940688.055276:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944884608:0@lo:400:kworker.0 00000100:00100000:1.0:1788940688.055298:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788940688.055303:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d035a50380, transno 4294967301 00000100:00100000:1.0:1788940688.055332:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944885632:0@lo:400:kworker.0 00000100:00100000:3.0:1788940688.057855:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944886144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11059us (14486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940688.057871:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:1.0:1788940688.059607:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07fdb480 x1875839944886144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940688.059659:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944886144:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788940688.668285:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940689.694497:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940690.588438:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940690.588461:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944886272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788940690.588548:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940690.588756:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944886272 00000100:00100000:2.0:1788940690.588777:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944886272 00000100:00100000:2.0:1788940690.588839:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788940690.588849:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944886272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940690.588890:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788940690.588952:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944886272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940690.588959:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788940690.589294:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944886272:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788940690.716011:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940690.726752:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940690.726810:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940690.726841:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940690.726880:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940690.726911:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921715712 00000100:00100000:1.0:1788940690.726922:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921715712 00000100:00100000:0.0:1788940690.726968:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921715840 00000100:00100000:0.0:1788940690.726972:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921715840 00000100:00100000:1.0:1788940690.726977:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 383 00000100:00100000:1.0:1788940690.726986:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2406:x1875839921715712:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940690.727009:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921716352 00000100:00100000:0.0:1788940690.727012:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921716352 00000100:00100000:0.0:1788940690.727030:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 288 00000100:00100000:0.0:1788940690.727036:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921715840:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940690.727071:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921715840:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 36us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940690.727083:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 288 00000100:00100000:0.0:1788940690.727101:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 289 00000100:00100000:0.0:1788940690.727107:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2406:x1875839921716352:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940690.727169:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921716096 00000100:00100000:3.0:1788940690.727174:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921716096 00000100:00100000:3.0:1788940690.727236:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 110 00000100:00100000:3.0:1788940690.727244:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921716096:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940690.728999:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2406:x1875839921715712:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 1999us (2103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940690.729015:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 383 00000100:00080000:1.0:1788940690.730682:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940690.730692:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940690.730696:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940690.730712:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2406:x1875839921716352:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 3599us (3864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940690.730724:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 289 00000100:00100000:1.0:1788940690.730759:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940690.730796:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921715968 00000100:00100000:0.0:1788940690.730804:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921715968 00000100:00080000:1.0:1788940690.730852:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788940690.730858:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 290 00000100:00100000:1.0:1788940690.730878:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940690.730879:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921715968:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940690.730896:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921716224 00000100:00100000:1.0:1788940690.730900:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921716224 00000100:00100000:1.0:1788940690.730930:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 291 00000100:00100000:1.0:1788940690.730936:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2406:x1875839921716224:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940690.730941:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921715968:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 77us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940690.730948:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 290 00000100:00080000:0.0:1788940690.730969:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940690.730978:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2406:x1875839921716224:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 42us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940690.730984:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 291 00000100:00100000:3.0:1788940690.731377:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921716096:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 4131us (4563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940690.731386:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 110 00000100:00100000:2.0:1788940691.099612:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940691.099638:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944886400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788940691.099709:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940691.099924:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944886400 00000100:00100000:3.0:1788940691.099932:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944886400 00000100:00100000:3.0:1788940691.099993:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788940691.100003:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944886400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788940691.100036:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940691.100088:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944886400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940691.100096:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788940691.100137:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944886400:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788940691.104128:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940691.104427:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944886528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940691.104498:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940691.104771:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944886528 00000100:00100000:3.0:1788940691.104781:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944886528 00000100:00100000:3.0:1788940691.104844:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788940691.104851:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944886528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940691.104871:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788940691.104913:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940691.104921:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944886528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940691.104941:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788940691.105062:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944886528:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788940691.740854:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940692.126466:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944886656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940692.126548:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940692.127928:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944886656 00000100:00100000:2.0:1788940692.127941:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944886656 00000100:00100000:2.0:1788940692.128008:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788940692.128020:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944886656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940692.128058:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940692.128125:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944886656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940692.128134:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788940692.128449:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944886656:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788940692.766004:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940693.147461:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944886784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940693.147484:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944886912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940693.148408:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944887040:0@lo:400:kworker.0 00000100:00100000:2.0:1788940693.150578:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944887168:0@lo:400:kworker.0 00000100:00100000:0.0:1788940693.151935:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940693.152024:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944887296:0@lo:400:kworker.0 00000100:00100000:0.0:1788940693.152058:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940693.152078:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839944887808:0@lo:400:kworker.0 00000100:00100000:0.0:1788940693.152125:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940693.152147:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944888320:0@lo:400:kworker.0 00000100:00100000:0.0:1788940693.152170:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940693.152222:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944886784 00000100:00100000:0.0:1788940693.152232:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944886784 00000100:00100000:0.0:1788940693.152315:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788940693.152326:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944886784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940693.152358:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940693.157072:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944886784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4740us (5135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940693.157084:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788940693.157137:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944887296 00000100:00100000:0.0:1788940693.157145:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944887296 00000100:00100000:0.0:1788940693.157201:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788940693.157210:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944887296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940693.157278:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944887296:12345-0@lo:400:kworker.0 Request processed in 69us (5219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940693.157285:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788940693.157306:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944887808 00000100:00100000:0.0:1788940693.157311:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944887808 00000100:00100000:0.0:1788940693.157341:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944888320 00000100:00100000:0.0:1788940693.157344:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944888320 00000100:00100000:0.0:1788940693.157394:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788940693.157401:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839944887808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940693.157438:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839944887808:12345-0@lo:400:kworker.0 Request processed in 37us (5313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940693.157444:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788940693.157456:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788940693.157462:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944888320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940693.157509:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944888320:12345-0@lo:400:kworker.0 Request processed in 47us (5337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940693.157515:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:0.0:1788940693.157540:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788940693.157544:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940693.159884:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944887296:0@lo:400:kworker.0 00010000:00080000:0.0:1788940693.159916:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07844700 x1875839944887808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940693.159926:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839944887808:0@lo:400:kworker.0 00010000:00080000:0.0:1788940693.159938:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf079e9500 x1875839944888320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940693.159946:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944888320:0@lo:400:kworker.0 00010000:00080000:0.0:1788940693.159957:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d037877480 x1875839944886784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940693.159974:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944886784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940693.161738:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940693.162131:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944887424:0@lo:400:kworker.0 00000100:00100000:1.0:1788940693.162172:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940693.162433:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944887424 00000100:00100000:1.0:1788940693.162442:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944887424 00000100:00100000:0.0:1788940693.162500:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944886912 00000100:00100000:0.0:1788940693.162505:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944886912 00000100:00100000:1.0:1788940693.162685:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788940693.162697:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944887424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940693.163059:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944887424:12345-0@lo:400:kworker.0 Request processed in 363us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940693.163070:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788940693.163075:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940693.163127:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944887552:0@lo:400:kworker.0 00000100:00100000:1.0:1788940693.163128:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944887424:0@lo:400:kworker.0 00000100:00100000:1.0:1788940693.163142:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944887936:0@lo:400:kworker.0 00000100:00100000:3.0:1788940693.163170:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940693.163180:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940693.163207:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944888064:0@lo:400:kworker.0 00000100:00100000:3.0:1788940693.163241:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944887552 00000100:00100000:3.0:1788940693.163245:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944887552 00000100:00100000:3.0:1788940693.163291:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788940693.163298:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944887552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940693.163339:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944887552:12345-0@lo:400:kworker.0 Request processed in 42us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940693.163345:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788940693.163382:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944887040 00000100:00100000:3.0:1788940693.163385:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944887040 00000100:00100000:3.0:1788940693.163413:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788940693.163420:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944887040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940693.163444:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944887936 00000100:00100000:1.0:1788940693.163450:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944887936 00000100:00100000:3.0:1788940693.163469:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944887040:12345-0@lo:400:kworker.0 Request processed in 49us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940693.163477:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788940693.163508:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940693.163530:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944888576:0@lo:400:kworker.0 00000100:00100000:3.0:1788940693.163550:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940693.163577:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944887040:0@lo:400:kworker.0 00000100:00100000:3.0:1788940693.163614:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944887552:0@lo:400:kworker.0 00000100:00100000:3.0:1788940693.163641:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944888064 00000100:00100000:3.0:1788940693.163644:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944888064 00000100:00100000:3.0:1788940693.163668:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944888576 00000100:00100000:3.0:1788940693.163671:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944888576 00000100:00100000:3.0:1788940693.163684:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788940693.163690:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944888064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940693.163737:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944888064:12345-0@lo:400:kworker.0 Request processed in 48us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940693.163743:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788940693.163769:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788940693.163775:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944888576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940693.163805:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944888576:12345-0@lo:400:kworker.0 Request processed in 31us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940693.163811:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788940693.163817:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788940693.163828:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944886912:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788940693.163829:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788940693.163835:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944887936:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788940693.163845:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940693.163865:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944887936:12345-0@lo:400:kworker.0 Request processed in 31us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940693.163871:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788940693.163875:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944886912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (2146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940693.163898:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944887936:0@lo:400:kworker.0 00000100:00100000:1.0:1788940693.163905:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944888448:0@lo:400:kworker.0 00000100:00100000:1.0:1788940693.163927:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940693.163945:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944888448 00000100:00100000:1.0:1788940693.163948:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944888448 00000100:00100000:1.0:1788940693.163965:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788940693.164053:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1788940693.164077:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940693.164081:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788940693.164114:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f5c000 x1875839944886912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940693.164131:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944886912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940693.164194:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944888064:0@lo:400:kworker.0 00010000:00080000:0.0:1788940693.164207:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f67100 x1875839944888576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940693.164216:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944888576:0@lo:400:kworker.0 00000100:00100000:1.0:1788940693.164292:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944888448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940693.164545:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944888448:12345-0@lo:400:kworker.0 Request processed in 574us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940693.164552:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:0.0:1788940693.166160:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf079ea300 x1875839944888448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940693.166176:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944888448:0@lo:400:kworker.0 00000100:00100000:2.0:1788940693.172094:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940693.172328:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944887680:0@lo:400:kworker.0 00000100:00100000:2.0:1788940693.172364:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940693.177053:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944888192:0@lo:400:kworker.0 00000100:00100000:2.0:1788940693.177134:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940693.181012:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944887168 00000100:00100000:0.0:1788940693.181029:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944887168 00000100:00100000:0.0:1788940693.181251:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944887680 00000100:00100000:0.0:1788940693.181281:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944887680 00000100:00100000:2.0:1788940693.185423:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944888192 00000100:00100000:2.0:1788940693.185438:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944888192 00000100:00100000:2.0:1788940693.185499:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788940693.185509:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944887168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940693.185613:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944887168:12345-0@lo:400:kworker.0 Request processed in 105us (13528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940693.185621:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788940693.185642:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1788940693.185649:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944887680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940693.185679:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944887680:12345-0@lo:400:kworker.0 Request processed in 31us (13314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940693.185685:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1788940693.185697:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788940693.185702:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944888192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940693.185727:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944888192:12345-0@lo:400:kworker.0 Request processed in 25us (8594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940693.185733:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788940693.185789:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944887168:0@lo:400:kworker.0 00000100:00100000:2.0:1788940693.185803:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944887680:0@lo:400:kworker.0 00000100:00100000:2.0:1788940693.185843:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944888192:0@lo:400:kworker.0 00000100:00080000:2.0:1788940693.185893:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788940693.787500:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788940694.107951:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788940694.173572:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788940694.811579:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940695.711816:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940695.711839:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944888704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788940695.711910:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940695.712071:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944888704 00000100:00100000:2.0:1788940695.712080:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944888704 00000100:00100000:2.0:1788940695.712134:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788940695.712145:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944888704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940695.712210:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788940695.712308:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944888704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 164us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940695.712316:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788940695.712445:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944888704:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788940695.835496:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940695.848659:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940695.848704:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940695.848867:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940695.848928:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921716480 00000100:00100000:1.0:1788940695.848939:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921716480 00000100:00100000:1.0:1788940695.848995:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 385 00000100:00100000:1.0:1788940695.849005:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921716480:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940695.849072:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921716480:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 68us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940695.849096:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 385 00000100:00100000:0.0:1788940695.851252:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921716736 00000100:00100000:0.0:1788940695.851284:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921716736 00000100:00100000:0.0:1788940695.851502:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921716608 00000100:00100000:0.0:1788940695.851506:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921716608 00000100:00100000:1.0:1788940695.851576:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 298 00000100:00100000:1.0:1788940695.851589:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921716736:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940695.851658:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921716736:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 71us (2953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940695.851666:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 298 00000100:00080000:3.0:1788940695.852899:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940695.852906:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788940695.853073:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 299 00000100:00100000:0.0:1788940695.853085:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921716608:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940695.853572:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921716608:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 489us (4703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940695.853581:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 299 00000100:00100000:0.0:1788940695.869066:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940695.870919:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940695.870968:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940695.871141:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921716992 00000100:00100000:2.0:1788940695.871152:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921716992 00000100:00100000:2.0:1788940695.871236:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921717120 00000100:00100000:2.0:1788940695.871240:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921717120 00000100:00100000:2.0:1788940695.871289:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 300 00000100:00100000:2.0:1788940695.871299:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921716992:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940695.871405:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921716992:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 107us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940695.871413:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 300 00000100:00100000:2.0:1788940695.871430:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 301 00000100:00100000:2.0:1788940695.871436:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921717120:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940695.871460:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921717120:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 24us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940695.871467:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 301 00000100:00080000:0.0:1788940695.874101:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788940695.874122:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940695.877289:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921716864 00000100:00100000:1.0:1788940695.877305:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921716864 00000100:00100000:1.0:1788940695.877587:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:1.0:1788940695.877599:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2403:x1875839921716864:12345-192.168.202.25@tcp:9:kworker.0 00000020:00000080:1.0:1788940695.877630:0:8437:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd354 00000100:00080000:1.0:1788940695.877639:0:8437:0:(import.c:65:import_set_state_nolock()) ffff91d035a1f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788940695.877693:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1788940695.877917:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+2:2403:x1875839921716864:12345-192.168.202.25@tcp:9:kworker.0 Request processed in 320us (8862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940695.877925:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 27 00010000:00010000:3.0:1788940695.879995:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788940695.883363:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940696.220499:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944888832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940696.220596:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940696.221410:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944888832 00000100:00100000:3.0:1788940696.221422:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944888832 00000100:00100000:3.0:1788940696.221491:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788940696.221504:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944888832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788940696.221547:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940696.221614:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944888832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940696.221636:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788940696.221734:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944888832:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788940696.223192:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940696.226934:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940696.226958:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944888960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940696.227041:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940696.227328:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944888960 00000100:00100000:3.0:1788940696.227337:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944888960 00000100:00100000:3.0:1788940696.227408:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788940696.227419:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944888960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940696.227443:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940696.227493:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944888960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940696.227500:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1788940696.227629:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940696.227709:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944888960:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788940696.859521:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940697.244965:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944889088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940697.245049:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940697.245373:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944889088 00000100:00100000:2.0:1788940697.245384:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944889088 00000100:00100000:2.0:1788940697.245436:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788940697.245445:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944889088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940697.245480:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940697.245534:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944889088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940697.245541:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788940697.245647:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944889088:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788940697.884184:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940698.270108:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944889344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940698.270189:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940698.270279:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940698.270286:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944889216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940698.270309:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940698.270387:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944889344 00000100:00100000:1.0:1788940698.270396:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944889344 00000100:00100000:1.0:1788940698.270466:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944889216 00000100:00100000:1.0:1788940698.270470:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944889216 00000100:00100000:1.0:1788940698.270488:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788940698.270497:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944889344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788940698.270527:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940698.270571:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944889344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940698.270578:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788940698.270594:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788940698.270600:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944889216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940698.270610:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940698.270632:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944889216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940698.270638:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1788940698.270914:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788940698.270946:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d037874a80 x1875839944889216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940698.270966:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944889216:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788940698.270978:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0012ad180 x1875839944889344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940698.270988:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944889344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940698.271684:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944889728:0@lo:400:kworker.0 00000100:00100000:0.0:1788940698.271732:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940698.271763:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944890240:0@lo:400:kworker.0 00000100:00100000:0.0:1788940698.271787:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940698.271805:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944890752:0@lo:400:kworker.0 00000100:00100000:0.0:1788940698.271825:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940698.271846:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788940698.271851:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944889856:0@lo:400:kworker.0 00000100:00100000:0.0:1788940698.271884:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940698.271908:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944890368:0@lo:400:kworker.0 00000100:00100000:0.0:1788940698.271931:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940698.271959:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944890240 00000100:00100000:0.0:1788940698.271965:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944890240 00000100:00100000:0.0:1788940698.272005:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944890752 00000100:00100000:0.0:1788940698.272008:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944890752 00000100:00100000:0.0:1788940698.272025:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944889856 00000100:00100000:0.0:1788940698.272027:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944889856 00000100:00100000:0.0:1788940698.272042:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788940698.272049:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944890240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940698.272091:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944890240:12345-0@lo:400:kworker.0 Request processed in 43us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940698.272096:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788940698.272112:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788940698.272118:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944890752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940698.272156:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944890752:12345-0@lo:400:kworker.0 Request processed in 39us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940698.272162:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788940698.272173:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788940698.272178:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944889856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940698.272205:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944889856:12345-0@lo:400:kworker.0 Request processed in 26us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940698.272210:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:0.0:1788940698.272231:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788940698.272252:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944889856:0@lo:400:kworker.0 00010000:00080000:0.0:1788940698.272288:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d037873100 x1875839944890240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940698.272309:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944890240:0@lo:400:kworker.0 00010000:00080000:0.0:1788940698.272320:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a50380 x1875839944890752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940698.272328:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944890752:0@lo:400:kworker.0 00000100:00100000:3.0:1788940698.272584:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944889728 00000100:00100000:3.0:1788940698.272590:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944889728 00000100:00100000:3.0:1788940698.272634:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788940698.272643:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944889728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940698.272697:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944889728:12345-0@lo:400:kworker.0 Request processed in 55us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940698.272703:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788940698.272723:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944890368 00000100:00100000:3.0:1788940698.272726:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944890368 00000100:00100000:3.0:1788940698.272755:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788940698.272761:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944890368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940698.272790:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944890368:12345-0@lo:400:kworker.0 Request processed in 30us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940698.272797:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1788940698.272812:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940698.272831:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944890368:0@lo:400:kworker.0 00000100:00100000:3.0:1788940698.272841:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944889728:0@lo:400:kworker.0 00000100:00100000:1.0:1788940698.273225:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944889472:0@lo:400:kworker.0 00000100:00100000:1.0:1788940698.273296:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940698.273340:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944889984:0@lo:400:kworker.0 00000100:00100000:1.0:1788940698.273362:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940698.273382:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944890496:0@lo:400:kworker.0 00000100:00100000:1.0:1788940698.273401:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940698.273421:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788940698.273427:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944889600:0@lo:400:kworker.0 00000100:00100000:1.0:1788940698.273446:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940698.273461:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944890112:0@lo:400:kworker.0 00000100:00100000:1.0:1788940698.273479:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940698.273514:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944890624:0@lo:400:kworker.0 00000100:00100000:1.0:1788940698.273537:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940698.273560:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944890496 00000100:00100000:1.0:1788940698.273565:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944890496 00000100:00100000:1.0:1788940698.273599:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788940698.273606:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944890496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940698.273846:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944889600 00000100:00100000:0.0:1788940698.273851:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944889600 00000100:00100000:0.0:1788940698.273882:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944890112 00000100:00100000:0.0:1788940698.273885:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944890112 00000100:00100000:0.0:1788940698.273897:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944890624 00000100:00100000:0.0:1788940698.273899:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944890624 00000100:00100000:0.0:1788940698.273911:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788940698.273917:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944889600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940698.273958:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944889600:12345-0@lo:400:kworker.0 Request processed in 41us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940698.273964:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788940698.273978:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788940698.273984:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944890112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940698.274012:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944890112:12345-0@lo:400:kworker.0 Request processed in 28us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940698.274017:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788940698.274028:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788940698.274033:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944890624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940698.274057:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944890624:12345-0@lo:400:kworker.0 Request processed in 25us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940698.274073:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788940698.274091:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944889984 00000100:00100000:0.0:1788940698.274095:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944889984 00000100:00100000:0.0:1788940698.274116:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788940698.274122:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944889984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940698.274402:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944889984:12345-0@lo:400:kworker.0 Request processed in 279us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940698.274408:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788940698.274444:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944889600:0@lo:400:kworker.0 00000100:00100000:0.0:1788940698.274454:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944890112:0@lo:400:kworker.0 00000100:00100000:0.0:1788940698.274462:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944890624:0@lo:400:kworker.0 00000100:00100000:0.0:1788940698.274470:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944889984:0@lo:400:kworker.0 00000100:00100000:1.0:1788940698.274678:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944890496:12345-0@lo:400:kworker.0 Request processed in 1072us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940698.274686:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788940698.275010:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944889472 00000100:00100000:3.0:1788940698.275015:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944889472 00000100:00100000:3.0:1788940698.275056:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788940698.275063:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944889472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940698.275096:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944889472:12345-0@lo:400:kworker.0 Request processed in 34us (1799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940698.275102:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00080000:3.0:1788940698.275131:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940698.275146:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940698.275253:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944889472:0@lo:400:kworker.0 00000100:00100000:0.0:1788940698.275574:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944890496:0@lo:400:kworker.0 00010000:00010000:3.0:1788940698.908029:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940699.931550:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940700.827578:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944890880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940700.827677:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940700.828401:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944890880 00000100:00100000:2.0:1788940700.828411:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944890880 00000100:00100000:2.0:1788940700.828468:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788940700.828479:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944890880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940700.828516:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788940700.828575:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944890880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940700.828582:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788940700.828627:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944890880:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788940700.955513:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940700.969972:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940700.970030:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940700.970069:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940700.970096:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940700.970160:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940700.970209:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921717376 00000100:00100000:0.0:1788940700.970221:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921717376 00000100:00100000:0.0:1788940700.970306:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921717632 00000100:00100000:0.0:1788940700.970309:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921717632 00000100:00100000:0.0:1788940700.970321:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921717504 00000100:00100000:0.0:1788940700.970323:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921717504 00000100:00100000:0.0:1788940700.970332:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921717760 00000100:00100000:0.0:1788940700.970335:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921717760 00000100:00100000:0.0:1788940700.970347:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 308 00000100:00100000:0.0:1788940700.970356:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921717376:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940700.970426:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921717376:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 71us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940700.970434:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 308 00000100:00100000:0.0:1788940700.970451:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 309 00000100:00100000:0.0:1788940700.970456:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921717632:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940700.970478:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921717632:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 22us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940700.970484:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 309 00000100:00100000:0.0:1788940700.970494:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 310 00000100:00100000:0.0:1788940700.970499:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921717504:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940700.970517:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921717504:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 19us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940700.970523:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 310 00000100:00100000:0.0:1788940700.970532:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 311 00000100:00100000:0.0:1788940700.970537:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921717760:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940700.970554:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921717760:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 17us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940700.970565:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 311 00000100:00100000:3.0:1788940700.970996:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921717248 00000100:00100000:3.0:1788940700.971003:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921717248 00000100:00100000:3.0:1788940700.971046:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 387 00000100:00100000:3.0:1788940700.971054:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921717248:12345-192.168.202.25@tcp:400:kworker.0 00000100:00080000:2.0:1788940700.971059:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940700.971063:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940700.971091:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921717248:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 38us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940700.971098:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 387 00000100:00100000:2.0:1788940701.341199:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940701.341225:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944891008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788940701.341321:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940701.341400:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944891008 00000100:00100000:2.0:1788940701.341408:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944891008 00000100:00100000:2.0:1788940701.341459:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788940701.341469:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944891008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788940701.341498:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940701.341537:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944891008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940701.341544:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788940701.341591:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944891008:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788940701.341612:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940701.342104:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940701.342127:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944891136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940701.342184:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940701.342285:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944891136 00000100:00100000:3.0:1788940701.342290:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944891136 00000100:00100000:3.0:1788940701.342338:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788940701.342345:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944891136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940701.342358:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940701.342394:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944891136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940701.342400:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788940701.342432:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944891136:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788940701.342526:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1788940701.870280:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 82f3b232-46da-4a78-8599-45df2ddbced0 00000020:00000080:3.0:1788940701.870290:0:8432:0:(genops.c:893:class_export_put()) final put ffff91d035a19000/82f3b232-46da-4a78-8599-45df2ddbced0 00000020:00000080:1.0:1788940701.870586:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff91d035a19000/82f3b232-46da-4a78-8599-45df2ddbced0 for lustre-OST0000 00000020:00000080:1.0:1788940701.870645:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d035a1f800 for lustre-OST0000 00010000:00010000:3.0:1788940701.980068:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940702.364131:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940702.364155:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944891264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788940702.364228:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940702.364375:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944891264 00000100:00100000:1.0:1788940702.364384:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944891264 00000100:00100000:1.0:1788940702.364433:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788940702.364443:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944891264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788940702.364478:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788940702.364535:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944891264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940702.364542:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788940702.365007:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944891264:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788940703.003485:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940703.387727:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944891392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940703.387817:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940703.387933:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944891392 00000100:00100000:0.0:1788940703.387942:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944891392 00000100:00100000:0.0:1788940703.387998:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788940703.388008:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944891392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788940703.388037:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940703.388082:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944891392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940703.388100:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1788940703.388124:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788940703.388153:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf0610b800 x1875839944891392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940703.388169:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944891392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940703.389005:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940703.389019:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944891520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940703.389077:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940703.389381:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944891520 00000100:00100000:1.0:1788940703.389389:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944891520 00000100:00100000:1.0:1788940703.389444:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788940703.389452:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944891520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940703.389468:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940703.389519:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944891520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940703.389526:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00080000:1.0:1788940703.389746:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d018b0b800 x1875839944891520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940703.389763:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944891520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940703.389949:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944891776:0@lo:400:kworker.0 00000100:00100000:0.0:1788940703.389982:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940703.390003:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944892288:0@lo:400:kworker.0 00000100:00100000:0.0:1788940703.390035:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940703.390058:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944892800:0@lo:400:kworker.0 00000100:00100000:0.0:1788940703.390079:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940703.390114:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788940703.390120:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944891904:0@lo:400:kworker.0 00000100:00100000:0.0:1788940703.390144:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940703.390162:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944892416:0@lo:400:kworker.0 00000100:00100000:0.0:1788940703.390180:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940703.390194:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944892928:0@lo:400:kworker.0 00000100:00100000:0.0:1788940703.390213:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940703.390238:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944891776 00000100:00100000:0.0:1788940703.390242:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944891776 00000100:00100000:0.0:1788940703.390296:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944892288 00000100:00100000:0.0:1788940703.390300:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944892288 00000100:00100000:0.0:1788940703.390316:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944892800 00000100:00100000:0.0:1788940703.390318:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944892800 00000100:00100000:0.0:1788940703.390330:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944892416 00000100:00100000:0.0:1788940703.390331:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944892416 00000100:00100000:0.0:1788940703.390342:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944892928 00000100:00100000:0.0:1788940703.390344:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944892928 00000100:00100000:0.0:1788940703.390359:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788940703.390365:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944891776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940703.390404:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944891776:12345-0@lo:400:kworker.0 Request processed in 39us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940703.390411:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788940703.390426:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788940703.390431:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944892288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940703.390470:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944892288:12345-0@lo:400:kworker.0 Request processed in 39us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940703.390476:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788940703.390488:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788940703.390494:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944892800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940703.390520:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944892800:12345-0@lo:400:kworker.0 Request processed in 28us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940703.390526:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788940703.390536:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788940703.390541:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944892416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940703.390567:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944892416:12345-0@lo:400:kworker.0 Request processed in 26us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940703.390571:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788940703.390582:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788940703.390587:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944892928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940703.390613:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944892928:12345-0@lo:400:kworker.0 Request processed in 26us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940703.390618:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788940703.390642:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944891904 00000100:00100000:0.0:1788940703.390646:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944891904 00000100:00100000:0.0:1788940703.390672:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788940703.390678:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944891904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940703.390708:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944891904:12345-0@lo:400:kworker.0 Request processed in 31us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940703.390714:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788940703.390763:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944891904:0@lo:400:kworker.0 00010000:00080000:0.0:1788940703.390775:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d037872680 x1875839944892416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940703.390784:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944892416:0@lo:400:kworker.0 00010000:00080000:0.0:1788940703.390794:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d037873100 x1875839944892928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940703.390801:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944892928:0@lo:400:kworker.0 00000100:00100000:0.0:1788940703.390811:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944891776:0@lo:400:kworker.0 00000100:00100000:0.0:1788940703.390820:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944892288:0@lo:400:kworker.0 00000100:00100000:0.0:1788940703.390827:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944892800:0@lo:400:kworker.0 00000100:00100000:1.0:1788940703.390932:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944891648:0@lo:400:kworker.0 00000100:00100000:1.0:1788940703.390964:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940703.390998:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944892160:0@lo:400:kworker.0 00000100:00100000:1.0:1788940703.391021:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940703.391040:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944892672:0@lo:400:kworker.0 00000100:00100000:1.0:1788940703.391061:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940703.391079:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788940703.391085:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944892032:0@lo:400:kworker.0 00000100:00100000:1.0:1788940703.391118:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940703.391133:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944892544:0@lo:400:kworker.0 00000100:00100000:1.0:1788940703.391153:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940703.391177:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944892160 00000100:00100000:1.0:1788940703.391181:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944892160 00000100:00100000:1.0:1788940703.391204:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788940703.391210:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944892160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940703.391242:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944892160:12345-0@lo:400:kworker.0 Request processed in 33us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940703.391249:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788940703.391291:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944892672 00000100:00100000:1.0:1788940703.391302:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944892672 00000100:00100000:1.0:1788940703.391332:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944892544 00000100:00100000:1.0:1788940703.391335:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944892544 00000100:00100000:1.0:1788940703.391356:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788940703.391363:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944892672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940703.391395:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944892672:12345-0@lo:400:kworker.0 Request processed in 33us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940703.391401:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788940703.391411:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788940703.391417:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944892544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940703.391442:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944892544:12345-0@lo:400:kworker.0 Request processed in 25us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940703.391448:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788940703.391480:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944892544:0@lo:400:kworker.0 00000100:00100000:1.0:1788940703.391489:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944892160:0@lo:400:kworker.0 00000100:00100000:1.0:1788940703.391497:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944892672:0@lo:400:kworker.0 00000100:00080000:2.0:1788940703.391579:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940703.391584:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940703.391586:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940703.391588:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940703.391722:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944891648 00000100:00100000:0.0:1788940703.391727:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944891648 00000100:00100000:0.0:1788940703.391766:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788940703.391773:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944891648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940703.391818:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944891648:12345-0@lo:400:kworker.0 Request processed in 46us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940703.391824:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788940703.391852:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944892032 00000100:00100000:0.0:1788940703.391856:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944892032 00000100:00100000:0.0:1788940703.391878:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788940703.391885:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944892032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940703.391918:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944892032:12345-0@lo:400:kworker.0 Request processed in 33us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940703.391934:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788940703.392047:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944892032:0@lo:400:kworker.0 00000100:00100000:1.0:1788940703.392056:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944891648:0@lo:400:kworker.0 00010000:00010000:0.0:1788940704.027422:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940704.353096:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788940704.412056:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788940705.053382:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940705.949032:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940705.949075:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944893056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940705.949175:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940705.949491:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944893056 00000100:00100000:2.0:1788940705.949503:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944893056 00000100:00100000:2.0:1788940705.949570:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788940705.949581:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944893056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940705.949638:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788940705.949701:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944893056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940705.949709:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788940705.950168:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944893056:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788940706.075806:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940706.092818:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940706.093027:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921717888 00000100:00100000:1.0:1788940706.093043:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921717888 00000100:00100000:1.0:1788940706.093166:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 389 00000100:00100000:1.0:1788940706.093180:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2405:x1875839921717888:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940706.093310:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2405:x1875839921717888:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 132us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940706.093331:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 389 00000100:00100000:1.0:1788940706.094591:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940706.095492:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921718016 00000100:00100000:2.0:1788940706.095509:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921718016 00000100:00100000:2.0:1788940706.095710:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 318 00000100:00100000:2.0:1788940706.095728:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921718016:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940706.095843:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921718016:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 121us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940706.095852:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 318 00000100:00080000:1.0:1788940706.096219:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940706.105707:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940706.105759:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940706.105885:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940706.105930:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921718144 00000100:00100000:1.0:1788940706.105941:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921718144 00000100:00100000:1.0:1788940706.106009:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921718272 00000100:00100000:1.0:1788940706.106013:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921718272 00000100:00100000:1.0:1788940706.106049:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921718400 00000100:00100000:1.0:1788940706.106053:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921718400 00000100:00100000:1.0:1788940706.106104:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 319 00000100:00100000:1.0:1788940706.106119:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921718144:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940706.106203:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921718144:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 87us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940706.106211:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 319 00000100:00100000:1.0:1788940706.106233:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 320 00000100:00100000:1.0:1788940706.106240:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921718272:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940706.106367:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 321 00000100:00100000:2.0:1788940706.106378:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921718400:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940706.106415:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921718400:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 40us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940706.106440:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 321 00000100:00100000:1.0:1788940706.107091:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921718272:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 850us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940706.107100:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 320 00000100:00080000:1.0:1788940706.107127:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940706.107133:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788940706.460473:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944893184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940706.460590:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940706.460707:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944893184 00000100:00100000:3.0:1788940706.460719:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944893184 00000100:00100000:3.0:1788940706.460801:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788940706.460815:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944893184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940706.460861:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940706.460916:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944893184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940706.460925:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1788940706.460979:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940706.461033:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944893184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940706.462175:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944893312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788940706.462238:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940706.462323:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944893312 00000100:00100000:2.0:1788940706.462330:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944893312 00000100:00100000:2.0:1788940706.462397:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788940706.462406:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944893312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788940706.462431:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940706.462473:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944893312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940706.462481:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788940706.462538:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944893312:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788940706.465165:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788940707.100222:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940707.487335:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944893440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788940707.487449:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940707.487557:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944893440 00000100:00100000:3.0:1788940707.487567:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944893440 00000100:00100000:3.0:1788940707.487629:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788940707.487640:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944893440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788940707.487687:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788940707.487748:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944893440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940707.487755:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788940707.487818:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944893440:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788940708.125013:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940708.507750:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944893696:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.507829:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940708.507891:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944894208:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.507916:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940708.507934:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839944894720:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.507955:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940708.507986:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788940708.507992:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944893568:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.508021:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940708.508053:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944894080:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.508078:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940708.508097:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944894592:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.508120:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940708.508137:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944895104:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.508157:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940708.508183:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944893824:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.508207:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940708.508225:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944894336:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.508246:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940708.508305:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944894848:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.508326:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940708.508343:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788940708.508348:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944893952:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.508369:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940708.508379:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944894464:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.508397:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940708.508424:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944894976:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.508445:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940708.508478:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944893696 00000100:00100000:1.0:1788940708.508486:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944893696 00000100:00100000:1.0:1788940708.508527:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944894208 00000100:00100000:1.0:1788940708.508530:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944894208 00000100:00100000:1.0:1788940708.508554:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944894720 00000100:00100000:1.0:1788940708.508557:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944894720 00000100:00100000:1.0:1788940708.508572:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944894336 00000100:00100000:1.0:1788940708.508575:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944894336 00000100:00100000:1.0:1788940708.508586:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944894848 00000100:00100000:1.0:1788940708.508588:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944894848 00000100:00100000:1.0:1788940708.508599:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944893952 00000100:00100000:1.0:1788940708.508601:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944893952 00000100:00100000:1.0:1788940708.508616:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788940708.508624:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944893696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.508676:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944893696:12345-0@lo:400:kworker.0 Request processed in 52us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940708.508684:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788940708.508700:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788940708.508706:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944894208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.508735:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944894208:12345-0@lo:400:kworker.0 Request processed in 30us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940708.508742:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788940708.508752:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788940708.508757:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839944894720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.508779:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839944894720:12345-0@lo:400:kworker.0 Request processed in 23us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940708.508794:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788940708.508806:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788940708.508811:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944894336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.508843:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944894336:12345-0@lo:400:kworker.0 Request processed in 32us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940708.508850:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788940708.508861:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788940708.508867:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944894848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.508893:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944894848:12345-0@lo:400:kworker.0 Request processed in 27us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940708.508898:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788940708.508909:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788940708.508914:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944893952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.508942:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944893952:12345-0@lo:400:kworker.0 Request processed in 27us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940708.508948:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788940708.508974:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944893568 00000100:00100000:1.0:1788940708.508978:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944893568 00000100:00100000:1.0:1788940708.509001:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788940708.509008:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944893568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.509035:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3648:x1875839944893568:12345-0@lo:400:kworker.0 Request processed in 28us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940708.509055:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788940708.509083:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944894080 00000100:00100000:1.0:1788940708.509087:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944894080 00000100:00100000:1.0:1788940708.509124:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944893824 00000100:00100000:1.0:1788940708.509127:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944893824 00000100:00100000:1.0:1788940708.509141:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788940708.509147:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944894080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.509178:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944894080:12345-0@lo:400:kworker.0 Request processed in 32us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940708.509184:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788940708.509195:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788940708.509200:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944893824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.509225:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944893824:12345-0@lo:400:kworker.0 Request processed in 25us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940708.509231:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788940708.509247:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944894592 00000100:00100000:1.0:1788940708.509251:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944894592 00000100:00100000:1.0:1788940708.509291:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944895104 00000100:00100000:1.0:1788940708.509295:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944895104 00000100:00100000:1.0:1788940708.509305:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944894464 00000100:00100000:1.0:1788940708.509307:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944894464 00000100:00100000:1.0:1788940708.509318:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944894976 00000100:00100000:1.0:1788940708.509320:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944894976 00000100:00100000:1.0:1788940708.509331:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788940708.509338:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944894592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.509369:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944894592:12345-0@lo:400:kworker.0 Request processed in 32us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940708.509375:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788940708.509386:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788940708.509392:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944895104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.509420:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944895104:12345-0@lo:400:kworker.0 Request processed in 29us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940708.509433:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788940708.509444:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788940708.509450:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944894464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.509478:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944894464:12345-0@lo:400:kworker.0 Request processed in 29us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940708.509484:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788940708.509495:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788940708.509500:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944894976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.509526:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944894976:12345-0@lo:400:kworker.0 Request processed in 26us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940708.509532:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1788940708.509610:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940708.509615:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940708.509618:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940708.509620:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940708.509656:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944893952:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.509668:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944894464:0@lo:400:kworker.0 00010000:00080000:1.0:1788940708.509679:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f67480 x1875839944894976/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940708.509690:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944894976:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.509699:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944893824:0@lo:400:kworker.0 00010000:00080000:1.0:1788940708.509708:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d018b0ad80 x1875839944894336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940708.509716:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944894336:0@lo:400:kworker.0 00010000:00080000:1.0:1788940708.509736:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a2ed80 x1875839944894848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940708.509744:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944894848:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.509783:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944895232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940708.509813:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940708.509840:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944893568:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.509851:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944894080:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.509861:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944894592:0@lo:400:kworker.0 00010000:00080000:1.0:1788940708.509870:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f64380 x1875839944895104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940708.509877:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944895104:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.509888:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944893696:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.509897:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944894208:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.509906:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839944894720:0@lo:400:kworker.0 00000100:00100000:1.0:1788940708.509944:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944895232 00000100:00100000:1.0:1788940708.509947:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944895232 00000100:00100000:1.0:1788940708.509972:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788940708.509978:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944895232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940708.509998:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940708.510029:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944895232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940708.510060:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00010000:00080000:1.0:1788940708.510090:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03588c380 x1875839944895232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940708.510102:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944895232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940708.512379:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940708.512403:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944895360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788940708.512471:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940708.512852:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944895360 00000100:00100000:3.0:1788940708.512862:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944895360 00000100:00100000:3.0:1788940708.512917:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788940708.512925:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944895360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788940708.512950:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940708.513799:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944895360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 871us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940708.513810:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00010000:00080000:0.0:1788940708.518968:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06ec5180 x1875839944895360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940708.519000:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944895360:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788940709.148400:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940710.182705:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788940710.588574:0:14068:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 03:58:29 (1788940709) 00000100:00100000:1.0:1788940711.067859:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940711.067899:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944895488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788940711.067975:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940711.068556:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944895488 00000100:00100000:2.0:1788940711.068566:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944895488 00000100:00100000:2.0:1788940711.068622:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788940711.068632:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944895488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940711.068668:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788940711.068754:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944895488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940711.068761:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788940711.068916:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944895488:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788940711.195556:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940711.209649:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940711.209701:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940711.209798:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940711.209857:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921718528 00000100:00100000:0.0:1788940711.209867:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921718528 00000100:00100000:0.0:1788940711.209934:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 391 00000100:00100000:0.0:1788940711.209946:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921718528:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940711.210054:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921718528:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 110us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940711.210062:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 391 00000100:00100000:2.0:1788940711.216195:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940711.221531:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921718784 00000100:00100000:1.0:1788940711.221549:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921718784 00000100:00100000:1.0:1788940711.222144:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921719040 00000100:00100000:1.0:1788940711.222151:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921719040 00000100:00100000:1.0:1788940711.222183:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 328 00000100:00100000:1.0:1788940711.222193:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921718784:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940711.222307:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921718784:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 114us (12604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940711.222314:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 328 00000100:00100000:1.0:1788940711.222334:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 329 00000100:00080000:3.0:1788940711.222504:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788940711.223682:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921719040:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940711.223825:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921719040:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 1483us (14025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940711.223834:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 329 00000100:00100000:2.0:1788940711.224667:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940711.224698:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921718656 00000100:00100000:2.0:1788940711.224706:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921718656 00000100:00080000:3.0:1788940711.224960:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940711.225141:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921718912 00000100:00100000:2.0:1788940711.225146:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921718912 00000100:00100000:2.0:1788940711.225176:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 330 00000100:00100000:2.0:1788940711.225184:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921718656:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940711.225244:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921718656:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 60us (9059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940711.225251:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 330 00000100:00100000:2.0:1788940711.225291:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 331 00000100:00100000:2.0:1788940711.225297:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921718912:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940711.225323:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921718912:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940711.225328:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 331 00000100:00080000:3.0:1788940711.225793:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940711.579886:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940711.579911:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944895616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940711.580158:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940711.580413:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940711.580436:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944895744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940711.580850:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940711.590921:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944895616 00000100:00100000:1.0:1788940711.590939:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944895616 00000100:00100000:1.0:1788940711.591056:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944895744 00000100:00100000:1.0:1788940711.591060:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944895744 00000100:00100000:1.0:1788940711.591083:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788940711.591093:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944895616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940711.591131:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940711.591237:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944895616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (11078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940711.591245:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788940711.591283:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788940711.591291:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944895744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788940711.591302:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940711.591333:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944895744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (10483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940711.591339:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788940711.591396:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944895616:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788940711.591727:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940711.591978:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944895744:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788940712.221973:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940712.603780:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944895872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788940712.603849:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940712.604097:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944895872 00000100:00100000:1.0:1788940712.604107:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944895872 00000100:00100000:1.0:1788940712.604164:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788940712.604174:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944895872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788940712.604206:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788940712.606885:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944895872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2702us (3024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940712.606899:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788940712.613022:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944895872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788940712.708180:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940712.708284:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921719168 00000100:00100000:2.0:1788940712.708295:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921719168 00000100:00100000:2.0:1788940712.708360:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:2.0:1788940712.708370:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:11130:x1875839921719168:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940712.708391:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940712.708450:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd434 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc722f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.708532:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd43b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.708546:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd43b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.708560:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd43b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940712.708632:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788940712.708636:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788940712.708679:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd43b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.708706:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd434 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc722f expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.708724:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd43b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc722f expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.708732:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e67a00) 00010000:00010000:2.0:1788940712.708735:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940712.708740:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6c00, rc 0) 00000100:00100000:2.0:1788940712.708803:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:11130:x1875839921719168:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 433us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940712.708809:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:2.0:1788940712.714071:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940712.719206:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921719296 00000100:00100000:0.0:1788940712.719222:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921719296 00000100:00100000:0.0:1788940712.719352:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 41 00000100:00100000:0.0:1788940712.719362:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:11131:x1875839921719296:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940712.719383:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940712.719527:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd442 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7236 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.719769:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd449 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.719785:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd449 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.719797:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd449 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.719812:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd450 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.719819:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.719826:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.719901:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d600/0x9c34acc08badd457 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.719909:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d600/0x9c34acc08badd457 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.719916:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d600/0x9c34acc08badd457 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940712.719953:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788940712.719957:0:8517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788940712.719978:0:8517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d600/0x9c34acc08badd457 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.719988:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd449 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.719995:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd449 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.720010:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd449 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.720017:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584c800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940712.720021:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd449 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.720029:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd449 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.720040:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e67a00) 00010000:00010000:0.0:1788940712.720048:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940712.720054:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd449 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.720061:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd449 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.720076:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.720082:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd450 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.720087:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd450 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.720093:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584c200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940712.720096:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd450 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.720101:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd450 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.720109:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91d0421d1200) 00010000:00010000:0.0:1788940712.720111:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940712.720114:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd450 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.720119:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd450 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.720149:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd442 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7236 expref: 8 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.720174:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d600/0x9c34acc08badd457 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7236 expref: 7 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940712.720181:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91d0421d1c00) 00010000:00010000:0.0:1788940712.720183:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940712.720186:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584d600, rc 0) 00000100:00100000:0.0:1788940712.721104:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+7:11131:x1875839921719296:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1737us (7036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940712.721114:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 41 00000100:00100000:3.0:1788940712.730759:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940712.730916:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921719424 00000100:00100000:1.0:1788940712.730926:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921719424 00000100:00100000:1.0:1788940712.730999:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:1.0:1788940712.731040:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:82f3b232-46da-4a78-8599-45df2ddbced0+7:11131:x1875839921719424:12345-192.168.202.25@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788940712.731133:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:82f3b232-46da-4a78-8599-45df2ddbced0+7:11131:x1875839921719424:12345-192.168.202.25@tcp:900:lhsmtool_posix.0 Request processed in 95us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940712.731141:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:2.0:1788940712.740298:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940712.740352:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921719680 00000100:00100000:2.0:1788940712.740362:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921719680 00000100:00100000:2.0:1788940712.740440:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00100000:2.0:1788940712.740451:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+7:11131:x1875839921719680:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940712.740475:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940712.740493:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd45e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc723d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740570:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd465 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740584:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd465 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740596:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd465 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740617:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd46c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740624:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd46c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740630:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd46c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740730:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6e00/0x9c34acc08badd473 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740738:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6e00/0x9c34acc08badd473 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740755:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6e00/0x9c34acc08badd473 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940712.740764:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788940712.740842:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd465 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740850:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd465 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740856:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd465 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740862:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940712.740866:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd465 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740873:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd465 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740885:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91d0421d1c00) 00010000:00010000:2.0:1788940712.740888:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940712.740893:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd465 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740899:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd465 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740911:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd46c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740917:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd46c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740928:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd46c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740933:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940712.740936:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd46c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740942:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd46c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740950:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91cf07e67300) 00010000:00010000:2.0:1788940712.740952:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940712.740955:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd46c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.740961:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd46c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.741243:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd45e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc723d expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.741283:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6e00/0x9c34acc08badd473 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc723d expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940712.741291:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91cf07e67400) 00010000:00010000:2.0:1788940712.741293:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940712.741295:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6e00, rc 0) 00000100:00100000:2.0:1788940712.741349:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+9:11131:x1875839921719680:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 901us (1062us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788940712.741364:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00100000:3.0:1788940712.748512:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940712.748552:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921719808 00000100:00100000:0.0:1788940712.748573:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921719808 00000100:00100000:0.0:1788940712.748637:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:0.0:1788940712.748646:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+9:11131:x1875839921719808:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788940712.748761:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+9:11131:x1875839921719808:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 Request processed in 115us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940712.748769:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:3.0:1788940712.755897:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940712.755993:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921719936 00000100:00100000:2.0:1788940712.756011:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921719936 00000100:00100000:2.0:1788940712.756077:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:2.0:1788940712.756088:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:11131:x1875839921719936:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788940712.757882:0:6520:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1746us 00000100:00100000:0.0:1788940712.795703:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:11131:x1875839921719936:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 Request processed in 39608us (39809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940712.795717:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 44 00010000:00010000:0.0:1788940713.244446:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788940713.563915:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788940713.629779:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788940713.629887:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944896000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940713.629962:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940713.630041:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944896000 00000100:00100000:1.0:1788940713.630050:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944896000 00000100:00100000:3.0:1788940713.630300:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d001378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944896128:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.630336:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940713.630373:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944896640:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.630400:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940713.630417:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944897152:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.630439:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940713.630460:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788940713.630480:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944896256:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.630507:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940713.630524:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944896768:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.630543:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940713.630790:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944897280:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.630813:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940713.630847:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944896128 00000100:00100000:3.0:1788940713.630852:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944896128 00000100:00100000:3.0:1788940713.630887:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788940713.630896:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944896128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.630945:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944896128:12345-0@lo:400:kworker.0 Request processed in 49us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940713.630952:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788940713.630979:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944896640 00000100:00100000:3.0:1788940713.630982:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944896640 00000100:00100000:3.0:1788940713.631016:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788940713.631022:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944896640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.631053:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944896640:12345-0@lo:400:kworker.0 Request processed in 31us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940713.631059:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788940713.631075:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944897152 00000100:00100000:3.0:1788940713.631078:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944897152 00000100:00100000:3.0:1788940713.631106:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788940713.631112:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944897152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.631142:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944897152:12345-0@lo:400:kworker.0 Request processed in 30us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940713.631159:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788940713.631178:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944896256 00000100:00100000:3.0:1788940713.631182:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944896256 00000100:00100000:3.0:1788940713.631205:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944896768 00000100:00100000:3.0:1788940713.631207:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944896768 00000100:00100000:3.0:1788940713.631224:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944897280 00000100:00100000:3.0:1788940713.631226:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944897280 00000100:00100000:3.0:1788940713.631273:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788940713.631282:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944896256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.631312:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944896256:12345-0@lo:400:kworker.0 Request processed in 33us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940713.631318:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788940713.631329:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788940713.631334:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944896768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.631371:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944896768:12345-0@lo:400:kworker.0 Request processed in 37us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940713.631377:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788940713.631389:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788940713.631395:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944897280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.631418:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944897280:12345-0@lo:400:kworker.0 Request processed in 24us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940713.631424:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788940713.631467:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944896384:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.631494:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940713.631514:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944896896:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.631536:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940713.632391:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944897408:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.632426:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940713.632450:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788940713.632457:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944896512:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.632480:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940713.632497:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944897024:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.632520:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940713.632538:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944897536:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.632569:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940713.632601:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944896384 00000100:00100000:3.0:1788940713.632607:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944896384 00000100:00100000:3.0:1788940713.632639:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788940713.632646:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944896384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.632689:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944896384:12345-0@lo:400:kworker.0 Request processed in 43us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940713.632695:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788940713.633635:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944896896 00000100:00100000:3.0:1788940713.633642:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944896896 00000100:00100000:3.0:1788940713.633685:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944897408 00000100:00100000:3.0:1788940713.633689:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944897408 00000100:00100000:3.0:1788940713.633708:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944896512 00000100:00100000:3.0:1788940713.633711:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944896512 00000100:00100000:3.0:1788940713.633854:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788940713.633862:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944896896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.634002:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944896896:12345-0@lo:400:kworker.0 Request processed in 132us (2456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940713.634009:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788940713.634035:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788940713.634040:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944897408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.634145:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944897408:12345-0@lo:400:kworker.0 Request processed in 104us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940713.634151:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788940713.634163:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788940713.634169:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944896512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.634195:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944896512:12345-0@lo:400:kworker.0 Request processed in 27us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940713.634200:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788940713.634806:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944896256:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.634823:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944896768:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.634836:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944897280:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.634846:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d001378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944896128:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.634856:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944896640:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.634867:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944897152:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.637850:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944897664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940713.638206:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940713.642791:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944897664 00000100:00100000:1.0:1788940713.642805:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944897664 00000100:00100000:1.0:1788940713.642854:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788940713.642865:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944896000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940713.642912:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940713.642981:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944896000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (13019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940713.642987:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788940713.643017:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788940713.643024:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944897664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788940713.643035:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940713.644697:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944897664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1667us (6485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940713.644708:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1788940713.644838:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940713.644843:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940713.644853:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940713.644856:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940713.644873:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944897024 00000100:00100000:1.0:1788940713.644880:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944897024 00000100:00100000:1.0:1788940713.644931:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944897536 00000100:00100000:1.0:1788940713.644935:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944897536 00000100:00100000:1.0:1788940713.644954:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788940713.644961:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944897024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940713.645029:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944897024:12345-0@lo:400:kworker.0 Request processed in 68us (12507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940713.645036:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788940713.645322:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788940713.645331:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944897536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940713.645439:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944897536:12345-0@lo:400:kworker.0 Request processed in 109us (12869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940713.645446:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1788940713.645789:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788940713.645909:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06ec5180 x1875839944896000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940713.645929:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944896000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940713.645969:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944896512:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.646000:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944897024:0@lo:400:kworker.0 00010000:00080000:3.0:1788940713.646013:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf0852d500 x1875839944897536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940713.646021:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944897536:0@lo:400:kworker.0 00000100:00100000:3.0:1788940713.646032:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944896384:0@lo:400:kworker.0 00010000:00080000:3.0:1788940713.646043:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0042b0380 x1875839944896896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940713.646059:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944896896:0@lo:400:kworker.0 00010000:00080000:3.0:1788940713.646071:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf0852d880 x1875839944897408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940713.646078:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944897408:0@lo:400:kworker.0 00010000:00080000:3.0:1788940713.646119:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d037885f80 x1875839944897664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940713.646132:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944897664:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788940714.269166:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940714.598504:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788940714.653471:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788940715.270877:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940715.270928:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921720064 00000100:00100000:1.0:1788940715.270938:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921720064 00000100:00100000:1.0:1788940715.271023:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00100000:1.0:1788940715.271035:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+9:11174:x1875839921720064:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788940715.271059:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940715.271090:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd481 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7244 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.271180:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badd488 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.271212:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badd488 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.271227:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badd488 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.271244:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd48f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.271277:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd48f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.271289:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd48f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.271343:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badd488 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.271356:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badd488 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.271367:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badd488 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.271379:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940715.271388:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badd488 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.271406:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badd488 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.271429:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e67a00) 00010000:00010000:1.0:1788940715.271445:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940715.271457:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badd488 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.271467:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badd488 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.271956:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd48f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.271965:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd48f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.271971:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd48f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.271990:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940715.271994:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd48f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.272000:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd48f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.272009:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91cf06dfea00) 00010000:00010000:1.0:1788940715.272012:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940715.272015:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd48f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.272021:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd48f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.272060:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd481 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7244 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.272084:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e67a00) 00010000:00010000:1.0:1788940715.272087:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940715.272091:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd481 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7244 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.272102:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602400, rc 0) 00000100:00100000:1.0:1788940715.272317:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+9:11174:x1875839921720064:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 1282us (1449us total) trans 0 rc 301/301 00000100:00100000:1.0:1788940715.272326:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00080000:1.0:1788940715.272374:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940715.276381:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940715.276433:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921720320 00000100:00100000:3.0:1788940715.276445:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921720320 00000100:00100000:3.0:1788940715.276515:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:3.0:1788940715.276528:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+9:11174:x1875839921720320:12345-192.168.202.25@tcp:36:lfs.0 00010000:00010000:3.0:1788940715.277126:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940715.277156:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd43b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc722f expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.277186:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e67a00) 00010000:00010000:3.0:1788940715.277199:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940715.277283:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd496 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.277298:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd496 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.277324:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd496 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.277338:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badd49d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.277346:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badd49d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.277353:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badd49d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.277986:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd4a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.277997:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd4a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.278005:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd4a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940715.278021:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cbfb6c0 reply state 000000007ea351ff transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd4a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.278042:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd4a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.278049:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:3.0:1788940715.278051:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788940715.278055:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788940715.278062:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788940715.278069:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd496 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.278076:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd496 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.278083:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd496 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.278089:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940715.278094:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd496 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.278101:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd496 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.278109:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65000) 00010000:00010000:3.0:1788940715.278111:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940715.278114:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd496 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.278120:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd496 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940715.278144:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cbfb6c0 reply state 000000007ea351ff transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badd49d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.278152:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badd49d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.278158:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91cf07e65500) 00010000:00010000:3.0:1788940715.278170:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788940715.278172:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788940715.278310:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+10:11174:x1875839921720320:12345-192.168.202.25@tcp:36:lfs.0 Request processed in 1784us (1937us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788940715.278318:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 46 00010000:00010000:1.0:1788940715.291436:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940715.359586:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940715.359679:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921720448 00000100:00100000:3.0:1788940715.359690:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921720448 00000100:00100000:3.0:1788940715.359758:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:3.0:1788940715.359770:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+10:11182:x1875839921720448:12345-192.168.202.25@tcp:101:lctl.0 00010000:00010000:3.0:1788940715.359802:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940715.359825:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd4ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc724b expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.359900:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08badd4b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.359916:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08badd4b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.359929:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08badd4b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940715.360008:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788940715.360012:0:8517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940715.360052:0:8517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08badd4b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.360079:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd4ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc724b expref: 12 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.360097:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08badd4b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc724b expref: 11 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.360105:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65000) 00010000:00010000:3.0:1788940715.360108:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940715.360112:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937800, rc 0) 00000100:00100000:3.0:1788940715.360175:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+11:11182:x1875839921720448:12345-192.168.202.25@tcp:101:lctl.0 Request processed in 406us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940715.360182:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:1.0:1788940715.430908:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940715.431127:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921720576 00000100:00100000:3.0:1788940715.431144:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921720576 00000100:00100000:3.0:1788940715.431230:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 48 00000100:00100000:3.0:1788940715.431244:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+11:11188:x1875839921720576:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1788940715.431338:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940715.431367:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd4b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7252 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.431456:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd4c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.431502:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd4c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.431519:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd4c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.431778:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd4c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.431790:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.431798:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.431913:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937e00/0x9c34acc08badd4ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.431922:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937e00/0x9c34acc08badd4ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.431929:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937e00/0x9c34acc08badd4ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940715.434279:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788940715.434295:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940715.434393:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937e00/0x9c34acc08badd4ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.434419:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd4c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.434453:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd4c0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.434461:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd4c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.434469:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940715.434474:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd4c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.434483:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd4c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.434504:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65000) 00010000:00010000:3.0:1788940715.434507:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940715.434514:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd4c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.434521:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd4c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.434558:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.434573:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd4c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.434579:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd4c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.434585:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940715.434595:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd4c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.434603:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd4c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.434611:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91cf07e65500) 00010000:00010000:3.0:1788940715.434614:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940715.434617:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd4c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.434623:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd4c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.434673:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd4b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7252 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.434691:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937e00/0x9c34acc08badd4ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7252 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.434711:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:3.0:1788940715.434714:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788940715.434717:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937e00, rc 0) 00000100:00100000:3.0:1788940715.434826:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+12:11188:x1875839921720576:12345-192.168.202.25@tcp:101:bash.0 Request processed in 3583us (3924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940715.434837:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 48 00000100:00100000:3.0:1788940715.440474:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940715.440583:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921720832 00000100:00100000:0.0:1788940715.440603:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921720832 00000100:00100000:0.0:1788940715.440683:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 49 00000100:00100000:0.0:1788940715.440833:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+12:11188:x1875839921720832:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:0.0:1788940715.440857:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940715.440882:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd4d5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7259 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.441332:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd4dc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.441350:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd4dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.441363:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd4dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.441380:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd4e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.441387:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd4e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.441394:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd4e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788940715.441857:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788940715.442030:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd4ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.442041:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd4ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.442050:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd4ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.442573:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd4dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.442582:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd4dc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.442590:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd4dc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.442597:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584de00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940715.442601:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd4dc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.442611:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd4dc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.442624:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:0.0:1788940715.442628:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940715.442634:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd4dc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.442640:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd4dc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940715.442653:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052c400ea reply state 00000000df9d1c17 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd4e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.442664:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd4e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.442670:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d0421d1b00) 00010000:00010000:0.0:1788940715.442679:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788940715.442683:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788940715.442804:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd4d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7259 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.442820:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd4ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7259 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.442828:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d0421d1800) 00010000:00010000:0.0:1788940715.442830:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940715.442832:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584ca00, rc 0) 00000100:00100000:0.0:1788940715.442913:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+15:11188:x1875839921720832:12345-192.168.202.25@tcp:101:bash.0 Request processed in 2083us (2453us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788940715.443155:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 49 00000100:00100000:1.0:1788940715.450027:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940715.455303:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921720960 00000100:00100000:2.0:1788940715.455322:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921720960 00000100:00100000:2.0:1788940715.455383:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:2.0:1788940715.455393:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1875839921720960:12345-192.168.202.25@tcp:8:bash.0 00010000:00080000:2.0:1788940715.455435:0:8437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:2.0:1788940715.455473:0:8437:0:(genops.c:1393:class_connect()) connect: client 82f3b232-46da-4a78-8599-45df2ddbced0, cookie 0x9c34acc08badd4f8 00002000:00100000:2.0:1788940715.455486:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 82f3b232-46da-4a78-8599-45df2ddbced0/ffff91d00c268000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788940715.455505:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:2.0:1788940715.455597:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788940715.455636:0:8437:0:(import.c:65:import_set_state_nolock()) ffff91d00c269000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940715.455751:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2403:x1875839921720960:12345-192.168.202.25@tcp:8:bash.0 Request processed in 357us (5735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940715.455760:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:1.0:1788940715.469909:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940715.470008:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921721088 00000100:00100000:3.0:1788940715.470018:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921721088 00000100:00100000:3.0:1788940715.470112:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:3.0:1788940715.470136:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+6:0:x1875839921721088:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1788940715.470157:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940715.470194:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057a6a172/0x9c34acc08badd4ff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7260 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940715.470220:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940715.470243:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1788940715.470247:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940715.470296:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057a6a172/0x9c34acc08badd4ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7260 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.470319:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000057a6a172/0x9c34acc08badd4ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7260 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.470332:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937c00, rc 0) 00000100:00100000:3.0:1788940715.470386:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:0:x1875839921721088:12345-192.168.202.25@tcp:101:bash.0 Request processed in 253us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940715.470393:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00080000:1.0:1788940715.470514:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940715.474717:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940715.475735:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921721216 00000100:00100000:1.0:1788940715.475746:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921721216 00000100:00100000:1.0:1788940715.475826:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:1.0:1788940715.476723:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+7:11188:x1875839921721216:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:1.0:1788940715.476746:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940715.476770:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badd506 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7267 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.476805:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000057a6a172/0x9c34acc08badd4ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7260 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.477492:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940715.477498:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940715.477745:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badd506 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7267 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.477790:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000057a6a172/0x9c34acc08badd4ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7260 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.477807:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000057a6a172/0x9c34acc08badd4ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7260 expref: 8 pid: 8438 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940715.478041:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8437:1875839944897792:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940715.478150:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d001374cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940715.491711:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940715.491746:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8437:1875839944897792:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940715.491788:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badd506 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7267 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.491812:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603a00, rc 0) 00000100:00100000:3.0:1788940715.491969:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921721344 00000100:00100000:3.0:1788940715.492012:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921721344 00010000:00010000:3.0:1788940715.492056:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000057a6a172/0x9c34acc08badd4ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7260 expref: 9 pid: 8438 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940715.492100:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:3.0:1788940715.492109:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+9:2405:x1875839921721344:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940715.492123:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940715.492164:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000057a6a172/0x9c34acc08badd4ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7260 expref: 9 pid: 8438 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.492180:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000057a6a172/0x9c34acc08badd4ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7260 expref: 9 pid: 8438 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.492208:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057a6a172/0x9c34acc08badd4ff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7260 expref: 9 pid: 8438 timeout: 570 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940715.492494:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+8:11188:x1875839921721216:12345-192.168.202.25@tcp:101:bash.0 Request processed in 16657us (17784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940715.492502:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 30 00010000:00010000:3.0:1788940715.492655:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940715.492661:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940715.492671:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badd506 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7267 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.492683:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badd506 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7267 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.492731:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badd506 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7267 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940715.492746:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0852d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6505:1875839944897920:192.168.202.25@tcp:105: 00000100:00100000:3.0:1788940715.492809:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0012ed180 going to sleep for 11 seconds 00000100:00100000:1.0:1788940715.505311:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940715.505433:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0852d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6505:1875839944897920:192.168.202.25@tcp:105: 00010000:00010000:3.0:1788940715.505459:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940715.505523:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921721344:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 13414us (13822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940715.505561:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:2.0:1788940715.506247:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921721600 00000100:00100000:2.0:1788940715.506288:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921721600 00000100:00100000:2.0:1788940715.506336:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:2.0:1788940715.506345:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+15:11188:x1875839921721600:12345-192.168.202.25@tcp:35:bash.0 00000100:00100000:2.0:1788940715.507007:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+16:11188:x1875839921721600:12345-192.168.202.25@tcp:35:bash.0 Request processed in 660us (1705us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788940715.507015:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:1.0:1788940715.614123:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940715.614375:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921721856 00000100:00100000:3.0:1788940715.614388:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921721856 00000100:00100000:3.0:1788940715.614468:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 50 00000100:00100000:3.0:1788940715.614479:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+16:11198:x1875839921721856:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940715.614508:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940715.614545:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd50d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc726e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940715.614655:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788940715.614760:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd50d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc726e expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.614775:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65000) 00010000:00010000:3.0:1788940715.614779:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788940715.614785:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd50d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc726e expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.614800:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937c00, rc 0) 00000100:00100000:3.0:1788940715.616725:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+17:11198:x1875839921721856:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 2234us (2599us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1788940715.616740:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 50 00000100:00100000:3.0:1788940715.631149:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940715.631574:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921722112 00000100:00100000:2.0:1788940715.631589:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921722112 00000100:00100000:2.0:1788940715.631676:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:2.0:1788940715.631689:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+17:11198:x1875839921722112:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:2.0:1788940715.634996:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+18:11198:x1875839921722112:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 3281us (4122us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788940715.635016:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:1.0:1788940715.755103:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940715.755307:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921722240 00000100:00100000:3.0:1788940715.755322:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921722240 00000100:00100000:3.0:1788940715.755407:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:3.0:1788940715.755419:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+18:11204:x1875839921722240:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940715.755462:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940715.755492:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd51b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7275 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.755884:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd522 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.755907:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd522 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.755927:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd522 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940715.756001:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788940715.756006:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940715.756884:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd522 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.756937:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd51b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7275 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.756984:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd522 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7275 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.756995:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:3.0:1788940715.756998:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940715.757003:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936200, rc 0) 00000100:00100000:2.0:1788940715.759321:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+19:11204:x1875839921722240:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 3841us (4172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940715.759336:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:1.0:1788940715.775546:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940715.775725:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921722496 00000100:00100000:0.0:1788940715.775739:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921722496 00000100:00100000:0.0:1788940715.775821:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:0.0:1788940715.775834:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+19:11204:x1875839921722496:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1788940715.775863:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940715.775890:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd529 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc727c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.776368:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd530 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.776389:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd530 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.776426:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd530 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940715.776443:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788940715.780492:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd529 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc727c expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.781961:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd530 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc727c expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.781996:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d0421d1800) 00010000:00010000:1.0:1788940715.781999:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940715.782004:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c200, rc 0) 00000100:00100000:1.0:1788940715.782145:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+21:11204:x1875839921722496:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 6309us (6618us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788940715.782157:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:3.0:1788940715.786247:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940715.786349:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940715.789346:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921722880 00000100:00100000:2.0:1788940715.789368:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921722880 00000100:00100000:2.0:1788940715.789472:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:2.0:1788940715.789482:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+21:2405:x1875839921722880:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940715.789503:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940715.789535:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd530 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc727c expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940715.789561:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d0421d1800) 00010000:00010000:2.0:1788940715.789567:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940715.789648:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+20:2405:x1875839921722880:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 167us (3299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940715.789677:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:1.0:1788940715.790141:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921722752 00000100:00100000:1.0:1788940715.790148:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921722752 00000100:00100000:1.0:1788940715.790201:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:1.0:1788940715.790210:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+20:11204:x1875839921722752:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788940715.790238:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940715.790278:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badd53e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7283 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.790424:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd545 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.790442:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd545 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.790457:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd545 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940715.790486:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788940715.790652:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badd53e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7283 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.790675:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd545 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7283 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.790684:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d0421d1800) 00010000:00010000:1.0:1788940715.790686:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788940715.790689:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602000, rc 0) 00000100:00100000:1.0:1788940715.790738:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+22:11204:x1875839921722752:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 529us (4506us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788940715.790745:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:3.0:1788940715.800681:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940715.800817:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921723008 00000100:00100000:1.0:1788940715.800831:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921723008 00000100:00100000:1.0:1788940715.800904:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:1.0:1788940715.800916:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:2404:x1875839921723008:12345-192.168.202.25@tcp:1:lfs.0 00010000:00010000:1.0:1788940715.800988:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badd553 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.801015:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badd506 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7267 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.801025:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788940715.801041:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788940715.801047:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badd553 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.801109:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badd506 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7267 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.801126:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badd506 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7267 expref: 7 pid: 8437 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940715.801147:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8438:1875839944898048:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940715.801328:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d005274180 going to sleep for 11 seconds 00000100:00100000:3.0:1788940715.805337:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8438:1875839944898048:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940715.805386:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badd553 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940715.813548:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940715.818136:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921723136 00000100:00100000:1.0:1788940715.818161:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921723136 00002000:00100000:1.0:1788940715.818242:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff91d035a53800 x1875839921723136/t0(0) o4->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:691/0 lens 504/0 e 0 to 0 dl 1788940726 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940715.818308:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91d035a53800 with x1875839921723136 ext(0->12) 00010000:00010000:1.0:1788940715.818322:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badd506 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7267 expref: 8 pid: 8437 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.818343:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badd506 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7267 expref: 8 pid: 8437 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940715.818352:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91d035a53800 00000100:00100000:1.0:1788940715.818397:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:1.0:1788940715.818410:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82f3b232-46da-4a78-8599-45df2ddbced0+8:2407:x1875839921723136:12345-192.168.202.25@tcp:4:lfs.0 00000001:00100000:3.0:1788940715.828570:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 82f3b232-46da-4a78-8599-45df2ddbced0 00000100:00100000:3.0:1788940715.832155:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82f3b232-46da-4a78-8599-45df2ddbced0+9:2407:x1875839921723136:12345-192.168.202.25@tcp:4:lfs.0 Request processed in 13732us (18612us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788940715.832177:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 0 00002000:00100000:3.0:1788940715.832193:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff91d035a53800 x1875839921723136/t4294967300(0) o4->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:691/0 lens 504/448 e 0 to 0 dl 1788940726 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788940715.832204:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91d035a53800 with x1875839921723136 ext(0->12) 00010000:00010000:3.0:1788940715.832215:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badd506 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7267 expref: 9 pid: 8437 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.832235:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badd506 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7267 expref: 9 pid: 8437 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940715.832244:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91d035a53800 00000100:00100000:1.0:1788940715.836565:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940715.836670:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921723264 00000100:00100000:3.0:1788940715.836682:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921723264 00010000:00010000:3.0:1788940715.836728:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badd506 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7267 expref: 9 pid: 8437 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940715.836778:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:3.0:1788940715.836793:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+9:2407:x1875839921723264:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940715.836824:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788940715.836845:0:6507:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788940715.836848:0:6507:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788940716 00002000:00010000:3.0:1788940715.836850:0:6507:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788940716 00002000:00010000:3.0:1788940715.836853:0:6507:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788940716 00002000:00010000:3.0:1788940715.836855:0:6507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788940715.836862:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badd506 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7267 expref: 9 pid: 8437 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.836876:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badd506 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7267 expref: 9 pid: 8437 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.836904:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badd506 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7267 expref: 9 pid: 8437 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.836923:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940715.836940:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940715.836947:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badd553 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.836958:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badd553 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.837439:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940715.837508:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+8:2407:x1875839921723264:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 718us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940715.837517:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 53 00010000:00010000:1.0:1788940715.837669:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badd553 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.837688:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badd553 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.837711:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badd553 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.837721:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badd553 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.837729:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badd553 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.837738:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940715.837744:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badd553 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.837754:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badd553 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.837771:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badd553 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.837778:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badd553 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940715.837856:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:2404:x1875839921723008:12345-192.168.202.25@tcp:1:lfs.0 Request processed in 36942us (37190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940715.837865:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:1.0:1788940715.843369:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940715.843460:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921723520 00000100:00100000:0.0:1788940715.843478:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921723520 00000100:00100000:0.0:1788940715.843581:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:0.0:1788940715.843595:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+22:11204:x1875839921723520:12345-192.168.202.25@tcp:35:lfs.0 00000004:00010000:0.0:1788940715.843684:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd545 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7283 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940715.847244:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1788940715.847328:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788940715.847775:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1788940715.847826:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd55a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.847854:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd4ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7259 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.847865:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd55a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.847917:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd4ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7259 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940715.847940:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd4ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7259 expref: 26 pid: 6520 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940715.847984:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037873800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1875839944898176:192.168.202.25@tcp:104: 00000100:00100000:0.0:1788940715.848114:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00dffa180 going to sleep for 11 seconds 00000100:00100000:2.0:1788940715.852629:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940715.853252:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037873800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1875839944898176:192.168.202.25@tcp:104: 00010000:00010000:0.0:1788940715.853331:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd55a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940715.856542:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921723648 00000100:00100000:3.0:1788940715.856560:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921723648 00010000:00010000:3.0:1788940715.856619:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd4ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7259 expref: 27 pid: 6520 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940715.856672:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:3.0:1788940715.856684:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+27:2405:x1875839921723648:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940715.856700:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940715.856707:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd4ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7259 expref: 27 pid: 6520 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.856721:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd4ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7259 expref: 27 pid: 6520 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.856746:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd4ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7259 expref: 27 pid: 6520 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.856764:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d0421d1800) 00010000:00010000:3.0:1788940715.856769:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd55a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.856779:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd55a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.856787:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd55a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940715.856831:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940715.856912:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+26:2405:x1875839921723648:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 230us (4292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940715.857115:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 54 00010000:00010000:2.0:1788940715.857819:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd55a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940715.857830:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd55a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940715.858113:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1788940715.858249:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1788940715.858406:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875839944898304:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788940715.858469:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940715.858503:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00d221180 going to sleep for 11 seconds 00000100:00100000:3.0:1788940715.858938:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944898304 00000100:00100000:3.0:1788940715.858946:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944898304 00000100:00100000:3.0:1788940715.859199:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788940715.859209:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1875839944898304:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788940715.859333:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1875839944898304:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 125us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940715.859340:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788940715.859565:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875839944898304:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788940715.859773:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1788940715.859833:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875839944898432:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788940715.859876:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940715.859978:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00ddf1c00 going to sleep for 11 seconds 00000100:00080000:1.0:1788940715.862105:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940715.862194:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944898432 00000100:00100000:3.0:1788940715.862205:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944898432 00000100:00100000:3.0:1788940715.862362:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788940715.862374:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1875839944898432:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788940715.865164:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6524:x1875839944898432:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 2783us (5277us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788940715.865182:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788940715.865371:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875839944898432:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788940715.865470:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1788940715.865667:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd55a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940715.865679:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd55a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940715.865688:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd55a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940715.865837:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584d200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940715.865842:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd55a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940715.865850:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd55a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940715.865866:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d0421d1800) 00010000:00010000:2.0:1788940715.865869:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788940715.865874:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd55a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940715.865880:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd55a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788940715.866080:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788940715.866145:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788940715.866157:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 471198898960ns, next at 472198896855ns, rc = 0 00000001:00080000:2.0:1788940715.866163:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1788940715.866189:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d0421d1800) 00010000:00010000:2.0:1788940715.866191:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788940715.866199:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd545 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7283 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940715.866516:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+29:11204:x1875839921723520:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 22923us (23154us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1788940715.866527:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 8 00000020:00080000:2.0:1788940715.866540:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788940715.873582:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940715.874143:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921723776 00000100:00100000:1.0:1788940715.874163:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921723776 00000100:00100000:1.0:1788940715.874249:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:1.0:1788940715.874281:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+29:11204:x1875839921723776:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788940715.874321:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940715.874355:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badd561 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc728a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.874436:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badd561 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc728a expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.874456:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badd561 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc728a expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.874480:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:1.0:1788940715.874484:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940715.874490:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603600, rc 0) 00000100:00100000:1.0:1788940715.874593:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+30:11204:x1875839921723776:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 316us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940715.874601:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:2.0:1788940715.879198:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940715.882387:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921724032 00000100:00100000:3.0:1788940715.882404:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921724032 00000100:00100000:3.0:1788940715.882522:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:3.0:1788940715.882545:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d002e64450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+30:11204:x1875839921724032:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:3.0:1788940715.882828:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d002e64450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+31:11204:x1875839921724032:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 295us (3639us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788940715.882836:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:2.0:1788940715.986570:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940715.986685:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921724288 00000100:00100000:1.0:1788940715.986696:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921724288 00000100:00100000:1.0:1788940715.986761:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:1.0:1788940715.986772:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+31:11214:x1875839921724288:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788940715.986798:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940715.986818:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd568 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7291 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940715.986930:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788940715.987044:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd568 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7291 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.987071:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65000) 00010000:00010000:1.0:1788940715.987074:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788940715.987079:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd568 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7291 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.987095:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603000, rc 0) 00000100:00100000:1.0:1788940715.987159:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+32:11214:x1875839921724288:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 389us (598us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1788940715.987166:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:0.0:1788940715.994841:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940715.996047:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921724416 00000100:00100000:1.0:1788940715.996060:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921724416 00000100:00100000:1.0:1788940715.996121:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:1.0:1788940715.996131:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+32:11214:x1875839921724416:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:1.0:1788940715.996207:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd576 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996240:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd576 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996253:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd576 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996281:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd57d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996288:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd57d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996295:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd57d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996804:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd584 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996814:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996822:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940715.996869:0:8517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996882:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd576 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996889:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd576 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996907:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd576 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996913:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940715.996917:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd576 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996925:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd576 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996936:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:1.0:1788940715.996939:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940715.996944:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd576 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996951:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd576 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996963:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd57d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996969:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd57d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996987:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd57d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.996993:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940715.996996:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd57d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.997011:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd57d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.997019:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d0421d1b00) 00010000:00010000:1.0:1788940715.997021:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940715.997025:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd57d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.997031:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd57d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.997040:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.997046:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd584 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.997052:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd584 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.997057:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940715.997060:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd584 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.997065:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd584 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.997071:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:1.0:1788940715.997073:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940715.997076:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd584 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940715.997089:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd584 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940715.997167:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+32:11214:x1875839921724416:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 1035us (2344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940715.997175:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:2.0:1788940715.999785:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940715.999945:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921724672 00000100:00100000:0.0:1788940715.999957:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921724672 00000100:00100000:0.0:1788940716.000027:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:0.0:1788940716.000038:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+32:11214:x1875839921724672:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1788940716.000312:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+33:11214:x1875839921724672:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 275us (536us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788940716.000319:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:2.0:1788940716.121311:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940716.121559:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921724928 00000100:00100000:3.0:1788940716.121570:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921724928 00000100:00100000:3.0:1788940716.121624:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:3.0:1788940716.121634:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+33:11217:x1875839921724928:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940716.121674:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940716.121696:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd58b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7298 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.121772:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd592 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.121789:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd592 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.121825:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd592 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.121845:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd599 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.121852:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd599 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.121860:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd599 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.121989:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08badd5a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.121998:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08badd5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.122005:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08badd5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940716.122015:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788940716.122101:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd592 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.122110:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd592 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.122116:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd592 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.122122:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940716.122127:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd592 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.122133:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd592 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.122144:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:3.0:1788940716.122147:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940716.122152:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd592 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.122158:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd592 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.122171:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd599 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.122176:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd599 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.122181:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd599 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.122196:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940716.122198:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd599 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.122204:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd599 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.122212:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d0421d1b00) 00010000:00010000:3.0:1788940716.122214:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940716.122217:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd599 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.122221:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd599 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.122300:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd58b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7298 expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.122313:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08badd5a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7298 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.122332:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:3.0:1788940716.122335:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940716.122337:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936400, rc 0) 00000100:00100000:3.0:1788940716.122410:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+35:11217:x1875839921724928:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 777us (1108us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788940716.122418:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:2.0:1788940716.125176:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940716.126056:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921725056 00000100:00100000:3.0:1788940716.126083:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921725056 00000100:00100000:3.0:1788940716.126153:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:3.0:1788940716.126163:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+35:11217:x1875839921725056:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:3.0:1788940716.126231:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badd5ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.126247:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badd5ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.126284:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badd5ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.126659:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badd5ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.126670:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badd5ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.126679:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badd5ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.126686:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940716.126691:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badd5ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.126701:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badd5ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.126714:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:3.0:1788940716.126718:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788940716.126724:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badd5ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.126743:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badd5ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940716.126966:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+35:11217:x1875839921725056:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 803us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940716.126986:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:3.0:1788940716.130688:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940716.134605:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921725312 00000100:00100000:0.0:1788940716.134623:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921725312 00000100:00100000:0.0:1788940716.134693:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00100000:0.0:1788940716.134704:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+35:11217:x1875839921725312:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1788940716.136215:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+36:11217:x1875839921725312:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 1504us (5529us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788940716.136229:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00100000:0.0:1788940716.187647:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944898560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940716.187722:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940716.188329:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944898560 00000100:00100000:1.0:1788940716.188338:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944898560 00000100:00100000:1.0:1788940716.188508:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788940716.188518:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944898560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788940716.188551:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1788940716.189536:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944898560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1015us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940716.189547:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788940716.196128:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944898560:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788940716.315610:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940716.325982:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940716.326179:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921725440 00000100:00100000:3.0:1788940716.326200:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921725440 00000100:00100000:3.0:1788940716.326338:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 393 00000100:00100000:3.0:1788940716.326351:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2405:x1875839921725440:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940716.326875:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2405:x1875839921725440:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 524us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940716.326886:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 393 00000100:00100000:2.0:1788940716.330594:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940716.330745:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940716.330783:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940716.336610:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921725696 00000100:00100000:3.0:1788940716.336627:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921725696 00000100:00100000:3.0:1788940716.336715:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921725568 00000100:00100000:3.0:1788940716.336719:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921725568 00000100:00100000:3.0:1788940716.336739:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921725824 00000100:00100000:3.0:1788940716.336742:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921725824 00000100:00100000:3.0:1788940716.336765:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 338 00000100:00100000:3.0:1788940716.336775:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921725696:12345-192.168.202.25@tcp:400:kworker.0 00000100:00080000:0.0:1788940716.337059:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788940716.337064:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940716.337091:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 339 00000100:00100000:0.0:1788940716.337100:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921725568:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940716.337171:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921725568:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 72us (6425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940716.337178:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 339 00000100:00100000:0.0:1788940716.337199:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 340 00000100:00100000:0.0:1788940716.337206:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921725824:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940716.337233:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921725824:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (6450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940716.337238:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 340 00000100:00100000:3.0:1788940716.337703:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921725696:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 928us (7118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940716.337712:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 338 00000100:00100000:0.0:1788940716.473686:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940716.473930:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921726080 00000100:00100000:2.0:1788940716.473940:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921726080 00000100:00100000:2.0:1788940716.475163:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:2.0:1788940716.475188:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+36:11248:x1875839921726080:12345-192.168.202.25@tcp:101:cat.0 00010000:00010000:2.0:1788940716.475218:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940716.475243:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd5b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc729f expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940716.475384:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd5bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940716.475400:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd5bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940716.475412:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd5bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940716.475423:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788940716.475555:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd5b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc729f expref: 39 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940716.475597:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd5bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc729f expref: 38 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940716.475605:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:2.0:1788940716.475608:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940716.475612:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6800, rc 0) 00000100:00100000:2.0:1788940716.475688:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+38:11248:x1875839921726080:12345-192.168.202.25@tcp:101:cat.0 Request processed in 514us (2012us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788940716.475696:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:0.0:1788940716.481787:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940716.481867:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940716.482095:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921726336 00000100:00100000:3.0:1788940716.482110:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921726336 00000100:00100000:3.0:1788940716.482186:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:3.0:1788940716.482199:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+38:11248:x1875839921726336:12345-192.168.202.25@tcp:35:cat.0 00000100:00100000:1.0:1788940716.482600:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921726464 00000100:00100000:1.0:1788940716.482615:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921726464 00000100:00100000:1.0:1788940716.482697:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:1.0:1788940716.482707:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037870e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+40:2406:x1875839921726464:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940716.482723:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940716.482750:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd5bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc729f expref: 40 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940716.482772:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:1.0:1788940716.482778:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940716.482841:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+39:11248:x1875839921726336:12345-192.168.202.25@tcp:35:cat.0 Request processed in 641us (1067us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1788940716.482848:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037870e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+39:2406:x1875839921726464:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 137us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940716.482864:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:1.0:1788940716.482884:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:1.0:1788940716.549871:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940716.550079:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921726720 00000100:00100000:3.0:1788940716.550095:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921726720 00000100:00100000:3.0:1788940716.550184:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 60 00000100:00100000:3.0:1788940716.550197:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+38:11254:x1875839921726720:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:3.0:1788940716.550367:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940716.550372:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788940716.550409:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd522 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7275 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.550432:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:3.0:1788940716.550438:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940716.550454:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badd5ca lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc72a6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.550611:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd5d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.550629:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08badd5a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7298 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.550638:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd5d1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.550720:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08badd5a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7298 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.550736:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08badd5a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7298 expref: 38 pid: 6522 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940716.550753:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944898688:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788940716.551120:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0207fbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940716.555359:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940716.555563:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944898688:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940716.555604:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd5d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940716.555751:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921726848 00000100:00100000:0.0:1788940716.555761:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921726848 00010000:00010000:0.0:1788940716.555818:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08badd5a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7298 expref: 39 pid: 6522 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940716.555868:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:0.0:1788940716.555880:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+39:2405:x1875839921726848:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940716.555900:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940716.555909:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08badd5a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7298 expref: 39 pid: 6522 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940716.555949:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08badd5a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7298 expref: 39 pid: 6522 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940716.555992:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08badd5a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7298 expref: 39 pid: 6522 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940716.556012:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:0.0:1788940716.556017:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd5d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940716.556027:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd5d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940716.556037:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd5d1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940716.556172:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940716.556298:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+38:2405:x1875839921726848:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 420us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940716.556306:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 55 00010000:00010000:1.0:1788940716.557689:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd5d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940716.557719:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd5d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940716.557748:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788940716.558451:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badd5ca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72a6 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940716.558484:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd5d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72a6 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940716.558495:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:1.0:1788940716.558499:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788940716.558503:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937c00, rc 0) 00000100:00100000:1.0:1788940716.558728:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+38:11254:x1875839921726720:12345-192.168.202.25@tcp:101:dd.0 Request processed in 8531us (8871us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788940716.558739:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 60 00000100:00100000:3.0:1788940716.563649:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940716.563880:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921726976 00000100:00100000:2.0:1788940716.563893:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921726976 00000100:00100000:2.0:1788940716.564098:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 61 00000100:00100000:2.0:1788940716.564112:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+38:11254:x1875839921726976:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:2.0:1788940716.564147:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940716.564172:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd5df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc72ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940716.564217:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd5e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940716.564248:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940716.564290:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940716.564453:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd5df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72ad expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940716.564480:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72ad expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940716.564490:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:2.0:1788940716.564493:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788940716.564499:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7000, rc 0) 00000100:00100000:2.0:1788940716.564792:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+39:11254:x1875839921726976:12345-192.168.202.25@tcp:101:dd.0 Request processed in 682us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940716.564800:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 61 00000100:00100000:0.0:1788940716.570438:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940716.570612:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921727232 00000100:00100000:2.0:1788940716.570628:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921727232 00000100:00100000:2.0:1788940716.570825:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 62 00000100:00100000:2.0:1788940716.570840:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+39:11254:x1875839921727232:12345-192.168.202.25@tcp:36:dd.0 00010000:00010000:2.0:1788940716.571207:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd5ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940716.571247:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd5ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940716.571295:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd5ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940716.571354:0:9713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1788940716.571385:0:9713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa663903 reply state 00000000dc6b917d transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd5ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940716.571400:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd5ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940716.571428:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:2.0:1788940716.571432:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788940716.571438:0:9713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940716.571588:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+42:11254:x1875839921727232:12345-192.168.202.25@tcp:36:dd.0 Request processed in 749us (1164us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1788940716.571596:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 62 00000020:00080000:2.0:1788940716.571603:0:9713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788940716.700335:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944898816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940716.700442:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940716.700938:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944898816 00000100:00100000:3.0:1788940716.700951:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944898816 00000100:00100000:3.0:1788940716.701046:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788940716.701059:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944898816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940716.701102:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940716.701164:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944898816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940716.701172:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788940716.701233:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944898816:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788940716.701411:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940716.702917:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944898944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940716.703041:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940716.703433:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944898944 00000100:00100000:0.0:1788940716.703446:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944898944 00000100:00100000:0.0:1788940716.703547:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788940716.703559:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944898944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788940716.703588:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940716.703647:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944898944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940716.703664:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1788940716.706186:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940716.706330:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944898944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940716.937813:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940716.937950:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921727360 00000100:00100000:3.0:1788940716.937977:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921727360 00000100:00100000:3.0:1788940716.938064:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 63 00000100:00100000:3.0:1788940716.938076:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+42:11268:x1875839921727360:12345-192.168.202.25@tcp:101:stat.0 00010000:00010000:3.0:1788940716.938111:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940716.938138:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd5f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc72b4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.938302:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd5fb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.938321:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd5fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.938339:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd5fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.938353:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd602 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.938360:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd602 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.938368:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd602 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.938464:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd609 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.938476:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd5d1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72a6 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.938485:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd609 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.938542:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd5d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72a6 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.938571:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd5d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72a6 expref: 43 pid: 6522 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940716.938589:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0042b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944899072:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788940716.938727:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0207fb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940716.943790:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940716.943904:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921727616 00000100:00100000:0.0:1788940716.943916:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921727616 00000100:00100000:0.0:1788940716.943998:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:0.0:1788940716.944011:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+44:6659:x1875839921727616:12345-192.168.202.25@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788940716.944484:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+45:6659:x1875839921727616:12345-192.168.202.25@tcp:35:ldlm_bl.0 Request processed in 473us (706us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788940716.944493:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:1.0:1788940716.945874:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0042b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944899072:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940716.945910:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd609 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940716.950399:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940716.950536:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921727744 00000100:00100000:1.0:1788940716.950551:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921727744 00010000:00010000:1.0:1788940716.950609:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd5d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72a6 expref: 45 pid: 6522 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940716.950669:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:1.0:1788940716.950681:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+45:2404:x1875839921727744:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940716.950719:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940716.950728:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd5d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72a6 expref: 45 pid: 6522 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940716.950745:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd5d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72a6 expref: 45 pid: 6522 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940716.950775:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd5d1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72a6 expref: 45 pid: 6522 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940716.950795:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:1.0:1788940716.950801:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd609 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940716.950836:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940716.950847:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd609 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940716.950892:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940716.950988:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+44:2404:x1875839921727744:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 308us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940716.950997:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 56 00010000:00010000:3.0:1788940716.951788:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.951802:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940716.951886:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788940716.951892:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940716.951951:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.951982:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd609 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.951994:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd5fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.952002:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd5fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.952010:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd5fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.952017:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940716.952034:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd5fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.952044:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd5fb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.952059:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:3.0:1788940716.952062:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940716.952067:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd5fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.952074:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd5fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.952088:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd602 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.952095:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd602 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.952100:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd602 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.952106:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940716.952108:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd602 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.952114:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd602 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.952122:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d0421d1b00) 00010000:00010000:3.0:1788940716.952124:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940716.952136:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd602 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.952142:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd602 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.952186:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd5f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72b4 expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.952201:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd609 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72b4 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940716.952209:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:3.0:1788940716.952211:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940716.952214:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937a00, rc 0) 00000100:00100000:3.0:1788940716.952350:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+43:11268:x1875839921727360:12345-192.168.202.25@tcp:101:stat.0 Request processed in 14275us (14551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940716.952360:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 63 00000100:00100000:2.0:1788940717.031404:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940717.031551:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921728000 00000100:00100000:0.0:1788940717.031566:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921728000 00000100:00100000:0.0:1788940717.031664:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:0.0:1788940717.031676:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+43:11274:x1875839921728000:12345-192.168.202.25@tcp:36:truncate.0 00010000:00010000:0.0:1788940717.031762:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940717.031800:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd609 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72b4 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.031827:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:0.0:1788940717.031834:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1788940717.032182:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788940717.032436:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd610 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.032455:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd610 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.032468:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd610 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940717.032521:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1788940717.032565:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000379d00c4 reply state 000000005e69ee6d transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd610 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.032580:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd610 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.032587:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:0.0:1788940717.032589:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788940717.032594:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940717.032750:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+45:11274:x1875839921728000:12345-192.168.202.25@tcp:36:truncate.0 Request processed in 1074us (1360us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788940717.032759:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 64 00000020:00080000:0.0:1788940717.032765:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788940717.186629:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940717.186865:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921728128 00000100:00100000:2.0:1788940717.186881:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921728128 00000100:00100000:2.0:1788940717.186978:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:2.0:1788940717.186991:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0854ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+45:11288:x1875839921728128:12345-192.168.202.25@tcp:101:stat.0 00010000:00010000:2.0:1788940717.187035:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940717.187072:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd617 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc72bb expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187166:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd61e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187187:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd61e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187203:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd61e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187244:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd625 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187252:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd625 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187307:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd625 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187415:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd62c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187425:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd62c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187432:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd62c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940717.187487:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788940717.187493:0:9713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788940717.187536:0:9713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd62c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187551:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd62c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187560:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd61e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187567:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd61e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187585:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd61e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187592:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940717.187598:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd61e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187608:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd61e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187623:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:2.0:1788940717.187626:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940717.187632:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd61e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187640:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd61e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187656:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd625 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187663:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd625 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187670:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd625 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187675:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940717.187678:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd625 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187709:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd625 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187719:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d0421d1b00) 00010000:00010000:2.0:1788940717.187721:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940717.187725:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd625 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187730:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd625 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187767:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd617 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72bb expref: 47 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187782:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd62c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72bb expref: 46 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.187790:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:2.0:1788940717.187792:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940717.187795:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6000, rc 0) 00000100:00100000:2.0:1788940717.187899:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0854ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+46:11288:x1875839921728128:12345-192.168.202.25@tcp:101:stat.0 Request processed in 911us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940717.187908:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:3.0:1788940717.302704:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940717.302835:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921728384 00000100:00100000:1.0:1788940717.302850:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921728384 00000100:00100000:1.0:1788940717.302930:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:1.0:1788940717.302942:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+46:11298:x1875839921728384:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788940717.302985:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940717.303012:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badd633 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc72c2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940717.303164:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788940717.303351:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badd633 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72c2 expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.303368:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65000) 00010000:00010000:1.0:1788940717.303371:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788940717.303378:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badd633 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72c2 expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.303416:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602200, rc 0) 00000100:00100000:1.0:1788940717.303496:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+47:11298:x1875839921728384:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 555us (818us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1788940717.303505:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:3.0:1788940717.308725:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940717.308951:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921728640 00000100:00100000:0.0:1788940717.308977:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921728640 00000100:00100000:0.0:1788940717.309054:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:0.0:1788940717.309067:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+47:11298:x1875839921728640:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1788940717.309425:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+48:11298:x1875839921728640:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 360us (715us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1788940717.309434:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 14 00010000:00010000:0.0:1788940717.340247:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940717.376803:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940717.376948:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921728896 00000100:00100000:0.0:1788940717.376978:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921728896 00000100:00100000:0.0:1788940717.377072:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:0.0:1788940717.377085:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+48:11304:x1875839921728896:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:0.0:1788940717.377123:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940717.377150:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd641 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc72c9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.377369:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd648 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.377390:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd62c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72bb expref: 49 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.377401:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd648 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.377450:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd62c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72bb expref: 49 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.377467:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd62c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72bb expref: 49 pid: 9713 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940717.377484:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037873100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875839944899200:192.168.202.25@tcp:104: 00000100:00100000:0.0:1788940717.377623:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00dffa240 going to sleep for 11 seconds 00000100:00100000:2.0:1788940717.382152:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940717.382307:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921729024 00000100:00100000:3.0:1788940717.382320:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921729024 00010000:00010000:3.0:1788940717.382381:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd62c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72bb expref: 50 pid: 9713 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940717.382448:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:3.0:1788940717.382461:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+50:2405:x1875839921729024:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940717.382481:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940717.382508:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd62c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72bb expref: 50 pid: 9713 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940717.382537:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd62c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72bb expref: 50 pid: 9713 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940717.382572:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:3.0:1788940717.382580:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd648 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940717.382595:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd648 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940717.382604:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd648 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940717.382629:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940717.382714:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+50:2405:x1875839921729024:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 256us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940717.382722:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 57 00010000:00010000:0.0:1788940717.383446:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd62c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72bb expref: 49 pid: 9713 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940717.383468:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037873100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875839944899200:192.168.202.25@tcp:104: 00010000:00010000:0.0:1788940717.383495:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd648 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.383505:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd648 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.383538:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd648 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940717.383563:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788940717.383740:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd641 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72c9 expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.383757:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd648 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72c9 expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.383765:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:0.0:1788940717.383768:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788940717.383771:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c200, rc 0) 00000100:00100000:0.0:1788940717.383821:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+49:11304:x1875839921728896:12345-192.168.202.25@tcp:101:bash.0 Request processed in 6740us (7034us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788940717.383830:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:3.0:1788940717.388776:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940717.388844:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921729280 00000100:00100000:0.0:1788940717.388860:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921729280 00000100:00100000:0.0:1788940717.389186:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 68 00000100:00100000:0.0:1788940717.389202:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+49:11304:x1875839921729280:12345-192.168.202.25@tcp:36:bash.0 00010000:00010000:0.0:1788940717.389561:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd656 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.389586:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd656 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.389602:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd656 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940717.389699:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1788940717.389727:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9eaec46 reply state 00000000684bc7e1 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd656 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.389742:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd656 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.389750:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:0.0:1788940717.389753:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788940717.389760:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940717.389869:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+52:11304:x1875839921729280:12345-192.168.202.25@tcp:36:bash.0 Request processed in 671us (1110us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1788940717.389876:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 68 00000020:00080000:0.0:1788940717.389882:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788940717.394770:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940717.394852:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921729408 00000100:00100000:2.0:1788940717.394866:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921729408 00000100:00100000:2.0:1788940717.394935:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 69 00000100:00100000:2.0:1788940717.394946:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+52:11304:x1875839921729408:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1788940717.395003:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940717.395030:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd65d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc72d0 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.395163:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd664 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.395192:0:8517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd648 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72c9 expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.395203:0:8517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd664 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.395247:0:8517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd648 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72c9 expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.395300:0:8517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd648 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72c9 expref: 53 pid: 6520 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940717.395317:0:8517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944899328:192.168.202.25@tcp:104: 00000100:00100000:2.0:1788940717.395421:0:8517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d010202540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940717.398629:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940717.398728:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921729536 00000100:00100000:3.0:1788940717.398741:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921729536 00010000:00010000:3.0:1788940717.398793:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd648 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72c9 expref: 54 pid: 6520 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940717.398841:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:3.0:1788940717.398853:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+54:2405:x1875839921729536:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940717.398890:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940717.398898:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd648 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72c9 expref: 54 pid: 6520 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940717.398915:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd648 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72c9 expref: 54 pid: 6520 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940717.398941:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:3.0:1788940717.398948:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd664 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940717.398976:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd664 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940717.398985:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd664 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940717.399011:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940717.399235:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+54:2405:x1875839921729536:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 381us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940717.399245:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 58 00010000:00010000:1.0:1788940717.400669:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd648 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72c9 expref: 53 pid: 6520 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940717.400712:0:8517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944899328:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940717.400748:0:8517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd664 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.400759:0:8517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd664 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.400765:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd664 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940717.400850:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788940717.400856:0:8517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788940717.400889:0:8517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd664 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.400932:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd65d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72d0 expref: 53 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.400949:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd664 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72d0 expref: 52 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.401159:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:1.0:1788940717.401163:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940717.401168:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6800, rc 0) 00000100:00100000:1.0:1788940717.401253:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+52:11304:x1875839921729408:12345-192.168.202.25@tcp:101:bash.0 Request processed in 6307us (6495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940717.401320:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 69 00000100:00100000:2.0:1788940717.405309:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940717.405428:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921729792 00000100:00100000:0.0:1788940717.405443:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921729792 00000100:00100000:0.0:1788940717.405514:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:0.0:1788940717.405534:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d002e67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+52:11304:x1875839921729792:12345-192.168.202.25@tcp:35:bash.0 00000100:00100000:0.0:1788940717.405848:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d002e67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+53:11304:x1875839921729792:12345-192.168.202.25@tcp:35:bash.0 Request processed in 314us (595us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788940717.405857:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:3.0:1788940717.487123:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940717.487252:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921730048 00000100:00100000:0.0:1788940717.487310:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921730048 00000100:00100000:0.0:1788940717.487394:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 70 00000100:00100000:0.0:1788940717.487406:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+53:11314:x1875839921730048:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1788940717.487443:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940717.487471:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd66b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc72d7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940717.487668:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788940717.487808:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd66b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72d7 expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.487825:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65000) 00010000:00010000:0.0:1788940717.487828:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940717.487835:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08badd66b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72d7 expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.487852:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584d200, rc 0) 00000100:00100000:0.0:1788940717.487938:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+54:11314:x1875839921730048:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 534us (899us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1788940717.487946:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 70 00000100:00100000:2.0:1788940717.492407:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940717.492480:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921730176 00000100:00100000:0.0:1788940717.492493:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921730176 00000100:00100000:0.0:1788940717.492571:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 71 00000100:00100000:0.0:1788940717.492582:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+54:11314:x1875839921730176:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:0.0:1788940717.492688:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd679 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.492709:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd679 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.492724:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd679 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.492736:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badd680 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.492761:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badd680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.492768:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badd680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.492863:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd687 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.492873:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.492879:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940717.492936:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.492951:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd679 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.492970:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd679 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.492979:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd679 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.492986:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584c200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940717.492991:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd679 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.493000:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd679 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.493020:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:0.0:1788940717.493023:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940717.493029:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd679 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.493037:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08badd679 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.493060:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badd680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.493065:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badd680 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.493071:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badd680 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.493076:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940717.493079:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badd680 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.493085:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badd680 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.493093:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d0421d1b00) 00010000:00010000:0.0:1788940717.493096:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940717.493099:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badd680 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.493105:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badd680 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.493126:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.493132:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd687 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.493139:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd687 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.493144:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000030e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940717.493146:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd687 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.493152:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd687 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.493158:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:0.0:1788940717.493160:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940717.493163:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd687 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.493169:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd687 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940717.493332:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+54:11314:x1875839921730176:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 750us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940717.493340:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 71 00000100:00100000:3.0:1788940717.496190:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940717.496283:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921730432 00000100:00100000:0.0:1788940717.496298:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921730432 00000100:00100000:0.0:1788940717.496378:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:0.0:1788940717.496412:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+54:11314:x1875839921730432:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1788940717.497721:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+55:11314:x1875839921730432:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 1303us (1537us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788940717.497733:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:3.0:1788940717.546657:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940717.546984:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921730688 00000100:00100000:1.0:1788940717.546998:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921730688 00000100:00100000:1.0:1788940717.547084:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 72 00000100:00100000:1.0:1788940717.547098:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+55:11317:x1875839921730688:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788940717.547134:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940717.547161:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badd68e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc72de expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.547307:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd695 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.547326:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd695 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.547340:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd695 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.547352:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd69c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.547360:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd69c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.547390:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd69c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.547801:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd6a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.547812:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.547823:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940717.547835:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788940717.547936:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd695 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.547945:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd695 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.547953:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd695 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.548202:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940717.548209:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd695 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.548220:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd695 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.548234:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:1.0:1788940717.548237:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940717.548254:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd695 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.548289:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd695 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.548307:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd69c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.548313:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd69c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.548320:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd69c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.548326:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940717.548329:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd69c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.548335:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd69c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.548344:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d0421d1b00) 00010000:00010000:1.0:1788940717.548346:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940717.548349:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd69c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.548356:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08badd69c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.548407:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badd68e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72de expref: 58 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.548434:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd6a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72de expref: 57 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.548442:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:1.0:1788940717.548444:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940717.548447:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603c00, rc 0) 00000100:00100000:1.0:1788940717.549334:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+57:11317:x1875839921730688:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 2231us (2686us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788940717.549348:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 72 00000100:00100000:2.0:1788940717.562098:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940717.562321:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940717.562501:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921730944 00000100:00100000:3.0:1788940717.562528:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921730944 00000100:00100000:3.0:1788940717.562642:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:3.0:1788940717.562657:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+57:2407:x1875839921730944:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940717.562717:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940717.562751:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd6a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72de expref: 57 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940717.562777:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:3.0:1788940717.562783:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940717.562857:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+56:2407:x1875839921730944:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 203us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940717.562864:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:1.0:1788940717.565242:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921730816 00000100:00100000:1.0:1788940717.565321:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921730816 00000100:00100000:1.0:1788940717.565453:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 73 00000100:00100000:1.0:1788940717.565466:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+56:11317:x1875839921730816:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:1.0:1788940717.565573:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badd6b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.565598:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badd6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.565614:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badd6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.565662:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badd6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.565670:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badd6b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.565717:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badd6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.565723:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940717.565729:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badd6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.565738:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badd6b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.565754:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:1.0:1788940717.565758:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788940717.565765:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badd6b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.565773:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badd6b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940717.565902:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+56:11317:x1875839921730816:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 437us (3822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940717.565912:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 73 00000100:00100000:2.0:1788940717.569605:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940717.569719:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921731200 00000100:00100000:3.0:1788940717.569731:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921731200 00000100:00100000:3.0:1788940717.569805:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:3.0:1788940717.569817:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+56:11317:x1875839921731200:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:3.0:1788940717.570126:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+57:11317:x1875839921731200:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 310us (535us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788940717.570135:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:0.0:1788940717.730101:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940717.730133:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00d26f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944899456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788940717.730236:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940717.730553:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944899456 00000100:00100000:2.0:1788940717.730573:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944899456 00000100:00100000:2.0:1788940717.730644:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788940717.730655:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944899456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940717.730717:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940717.730786:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944899456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940717.730795:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788940717.730855:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00d26f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944899456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788940717.743845:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940717.743985:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921731456 00000100:00100000:0.0:1788940717.744002:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921731456 00000100:00100000:0.0:1788940717.744088:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 74 00000100:00100000:0.0:1788940717.744100:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+57:11335:x1875839921731456:12345-192.168.202.25@tcp:101:cat.0 00010000:00010000:0.0:1788940717.744136:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940717.744163:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd6b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc72e5 expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.744355:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badd6bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.744373:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badd6bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.744390:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badd6bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940717.744403:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788940717.744577:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd6b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72e5 expref: 60 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.744635:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badd6bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72e5 expref: 59 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.744647:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:0.0:1788940717.744650:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788940717.744655:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d000031000, rc 0) 00000100:00100000:0.0:1788940717.744735:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+59:11335:x1875839921731456:12345-192.168.202.25@tcp:101:cat.0 Request processed in 636us (905us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1788940717.744743:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 74 00000001:00080000:3.0:1788940717.747917:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:3.0:1788940717.747982:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788940717.748005:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91d00d2216c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788940717.748010:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91d035993e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91d00d221180 00000020:00080000:3.0:1788940717.748014:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91d035993b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91cf07c24200 00010000:00010000:1.0:1788940717.749329:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badd49d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749360:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badd49d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749368:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badd49d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749375:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940717.749394:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badd49d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749403:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badd49d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749420:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91cf07e65500) 00010000:00010000:1.0:1788940717.749423:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940717.749428:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badd49d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749434:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badd49d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749457:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd4a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749464:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd4a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749469:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd4a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749474:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940717.749477:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd4a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749482:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd4a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749489:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:1.0:1788940717.749492:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940717.749501:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd4a4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749507:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd4a4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749525:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd4e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749531:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd4e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749538:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd4e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749544:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584c800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940717.749547:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd4e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749555:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd4e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749563:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d0421d1b00) 00010000:00010000:1.0:1788940717.749565:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940717.749568:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd4e3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749573:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badd4e3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749589:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd5ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749604:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd5ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749611:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd5ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749618:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940717.749621:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd5ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749628:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd5ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749636:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:1.0:1788940717.749638:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940717.749641:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd5ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749645:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd5ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749658:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd610 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749663:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd610 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749668:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd610 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749673:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584ca00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940717.749681:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd610 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749687:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd610 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749694:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:1.0:1788940717.749697:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940717.749699:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd610 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749705:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08badd610 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749713:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd656 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749719:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd656 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749725:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd656 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749745:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584de00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940717.749749:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd656 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749755:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd656 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749765:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:1.0:1788940717.749768:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788940717.749774:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788940717.749780:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd656 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.749789:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08badd656 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940717.749808:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944899584:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1788940717.749816:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:0.0:1788940717.749918:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788940717.750515:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788940717.753238:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944899584 00000100:00100000:2.0:1788940717.753305:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944899584 00000100:00100000:2.0:1788940717.753415:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788940717.753434:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1875839944899584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788940717.753480:0:8524:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00000100:00080000:1.0:1788940717.753481:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1788940717.753529:0:8524:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa111ac, atime: 0x6aa111ac, ctime: 0x6aa111ac, blocks: 0x8 00010000:00010000:2.0:1788940717.753541:0:8524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef825f55/0x9c34acc08badd6cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.753562:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788940717.753568:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940717.753576:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef825f55/0x9c34acc08badd6cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.753598:0:8524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef825f55/0x9c34acc08badd6cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.753609:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef825f55/0x9c34acc08badd6cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.753634:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef825f55/0x9c34acc08badd6cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.753657:0:8524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940717.753695:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940717.753707:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef825f55/0x9c34acc08badd6cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.753722:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6000 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940717.753727:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef825f55/0x9c34acc08badd6cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.753750:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef825f55/0x9c34acc08badd6cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.753774:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef825f55/0x9c34acc08badd6cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.753783:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef825f55/0x9c34acc08badd6cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.753810:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940717.753813:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940717.753815:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940717.753898:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3647:x1875839944899584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 471us (3979us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788940717.753906:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:0.0:1788940717.754034:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d037873100/2, rc 0, transno 4294967302 00000100:00100000:0.0:1788940717.754356:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944899584:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788940717.782449:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940717.783457:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921731584 00000100:00100000:1.0:1788940717.783478:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921731584 00000100:00100000:2.0:1788940717.783718:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 75 00000100:00100000:2.0:1788940717.783734:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+13:11336:x1875839921731584:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1788940717.783768:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940717.783796:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd6d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc72ec expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.783892:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd6db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.783912:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd6db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.783929:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd6db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940717.784015:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788940717.784020:0:8517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788940717.784054:0:8517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd6db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.784089:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd6d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72ec expref: 15 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.784134:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd6db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72ec expref: 14 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940717.784143:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:2.0:1788940717.784146:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940717.784151:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6c00, rc 0) 00000100:00100000:2.0:1788940717.784239:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+14:11336:x1875839921731584:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 508us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940717.784247:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 75 00000100:00100000:1.0:1788940717.792030:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940717.792128:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921731968 00000100:00100000:3.0:1788940717.792139:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921731968 00000100:00100000:3.0:1788940717.792203:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:3.0:1788940717.792214:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+14:11336:x1875839921731968:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:3.0:1788940717.792582:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+15:11336:x1875839921731968:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 369us (562us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788940717.792591:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:1.0:1788940717.798232:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940717.798387:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921732096 00000100:00100000:3.0:1788940717.798397:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921732096 00000100:00100000:3.0:1788940717.798456:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:3.0:1788940717.798467:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08548380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+15:11336:x1875839921732096:12345-192.168.202.25@tcp:103:lfs.0 00010000:00010000:3.0:1788940717.798483:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788940717.798506:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd664 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72d0 expref: 15 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940717.798638:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badd6bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72e5 expref: 14 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940717.798651:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badd561 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc728a expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940717.798661:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:3.0:1788940717.798666:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940717.798725:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08548380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+12:11336:x1875839921732096:12345-192.168.202.25@tcp:103:lfs.0 Request processed in 260us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940717.798732:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:0.0:1788940717.800898:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940717.803434:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921732224 00000100:00100000:1.0:1788940717.803454:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921732224 00000100:00100000:1.0:1788940717.803543:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 76 00000100:00100000:1.0:1788940717.803556:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+12:11336:x1875839921732224:12345-192.168.202.25@tcp:58:lfs.0 00010000:00010000:1.0:1788940717.803722:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd6e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.803748:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd6e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940717.803762:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd6e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940717.804023:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940717.804511:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788940717.804604:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788940717.805071:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+12:11336:x1875839921732224:12345-192.168.202.25@tcp:58:lfs.0 Request processed in 1511us (4182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940717.805082:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 76 00000100:00100000:1.0:1788940717.861313:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940717.861416:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921732352 00000100:00100000:0.0:1788940717.861427:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921732352 00000100:00100000:0.0:1788940717.861488:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 77 00000100:00100000:0.0:1788940717.861498:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+12:11338:x1875839921732352:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1788940717.861529:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940717.861549:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08badd6e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc72f3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861616:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd6f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861642:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd6f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861655:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd6f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861669:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badd6f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861677:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badd6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861683:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badd6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861771:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd6fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861780:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd6fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861787:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd6fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940717.861830:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788940717.861835:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788940717.861853:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd6fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861865:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd6fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861885:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd6f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861891:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd6f0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861898:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd6f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861904:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940717.861909:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd6f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861916:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd6f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861927:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:0.0:1788940717.861930:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940717.861935:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd6f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861941:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd6f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861965:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badd6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861972:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badd6f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861978:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badd6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861990:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940717.861992:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badd6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.861998:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badd6f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.862007:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d0421d1200) 00010000:00010000:0.0:1788940717.862009:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940717.862012:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badd6f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.862017:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badd6f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.862062:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08badd6e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72f3 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.862077:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd6fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72f3 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940717.862084:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:0.0:1788940717.862086:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940717.862089:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d000031200, rc 0) 00000100:00100000:0.0:1788940717.862166:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+13:11338:x1875839921732352:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 669us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940717.862175:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 77 00010000:00010000:3.0:1788940718.365751:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940718.683564:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940718.683585:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940718.683636:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788940718.683647:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788940718.684102:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037870e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1875839944899712:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788940718.684835:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0358d86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940718.709556:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037870e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1875839944899712:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788940718.731115:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940718.731219:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921732480 00000100:00100000:3.0:1788940718.731234:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921732480 00000100:00100000:3.0:1788940718.731342:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 78 00000100:00100000:3.0:1788940718.731357:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+13:11349:x1875839921732480:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788940718.731414:0:8517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788940718.731590:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+13:11349:x1875839921732480:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 236us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940718.731599:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 78 00000100:00100000:1.0:1788940718.750582:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944899840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940718.750686:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940718.750756:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944900352:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.750786:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940718.750828:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944900864:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.750871:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940718.750897:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944901376:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.750953:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940718.750986:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788940718.750994:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944899968:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.751028:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940718.751056:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944900480:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.751084:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940718.751105:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944900992:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.751128:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940718.751147:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944901504:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.751170:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940718.751205:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944900224:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.751230:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940718.751250:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944900736:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.751310:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940718.751334:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944901248:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.751357:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940718.751380:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788940718.751386:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944900096:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.751409:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940718.751429:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944900608:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.751452:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940718.751469:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839944901120:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.751505:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940718.751533:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944899840 00000100:00100000:1.0:1788940718.751545:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944899840 00000100:00100000:1.0:1788940718.751615:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788940718.751628:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875839944899840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940718.751670:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940718.751723:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875839944899840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940718.751732:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788940718.751764:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944900352 00000100:00100000:1.0:1788940718.751768:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944900352 00000100:00100000:1.0:1788940718.751792:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944900736 00000100:00100000:1.0:1788940718.751795:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944900736 00000100:00100000:1.0:1788940718.751822:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944901248 00000100:00100000:1.0:1788940718.751825:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944901248 00000100:00100000:1.0:1788940718.751840:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944900096 00000100:00100000:1.0:1788940718.751843:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944900096 00000100:00100000:1.0:1788940718.751855:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944900608 00000100:00100000:1.0:1788940718.751857:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944900608 00000100:00100000:1.0:1788940718.751872:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944901120 00000100:00100000:1.0:1788940718.751875:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944901120 00000100:00100000:1.0:1788940718.751891:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788940718.751898:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944900352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.751941:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944900352:12345-0@lo:400:kworker.0 Request processed in 44us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940718.752285:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944901632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940718.752321:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940718.752364:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788940718.752373:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944900736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940718.752414:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944900736:12345-0@lo:400:kworker.0 Request processed in 43us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940718.752422:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788940718.752447:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788940718.752454:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944901248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940718.752486:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944901248:12345-0@lo:400:kworker.0 Request processed in 32us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940718.752493:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788940718.752509:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788940718.752516:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944900096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940718.752550:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944900096:12345-0@lo:400:kworker.0 Request processed in 35us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940718.752556:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788940718.752569:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788940718.752584:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944900608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940718.752616:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944900608:12345-0@lo:400:kworker.0 Request processed in 34us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940718.752622:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788940718.752635:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788940718.752641:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839944901120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940718.752670:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839944901120:12345-0@lo:400:kworker.0 Request processed in 29us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940718.752675:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788940718.752699:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944901632 00000100:00100000:0.0:1788940718.752704:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944901632 00000100:00100000:0.0:1788940718.752745:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788940718.752752:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944901632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788940718.752766:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940718.752817:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944901632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940718.752826:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788940718.752868:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944901632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940718.752981:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944900096:0@lo:400:kworker.0 00000100:00100000:0.0:1788940718.752991:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944900608:0@lo:400:kworker.0 00000100:00100000:0.0:1788940718.753000:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839944901120:0@lo:400:kworker.0 00010000:00080000:0.0:1788940718.753017:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d020af9f80 x1875839944900736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940718.753027:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944900736:0@lo:400:kworker.0 00010000:00080000:0.0:1788940718.753037:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d020afbb80 x1875839944901248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940718.753055:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944901248:0@lo:400:kworker.0 00000100:00100000:2.0:1788940718.756300:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944900864 00000100:00100000:2.0:1788940718.756321:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944900864 00000100:00100000:2.0:1788940718.756379:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944901376 00000100:00100000:2.0:1788940718.756383:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944901376 00000100:00100000:2.0:1788940718.756400:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944900992 00000100:00100000:2.0:1788940718.756403:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944900992 00000100:00100000:2.0:1788940718.756422:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944901504 00000100:00100000:2.0:1788940718.756425:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944901504 00000100:00100000:2.0:1788940718.756449:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788940718.756462:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944900864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940718.756582:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944900864:12345-0@lo:400:kworker.0 Request processed in 123us (5709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940718.756591:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788940718.756614:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788940718.756620:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944901376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940718.756651:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944901376:12345-0@lo:400:kworker.0 Request processed in 32us (5708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940718.756669:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788940718.756682:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788940718.756689:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944900992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940718.756721:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944900992:12345-0@lo:400:kworker.0 Request processed in 33us (5592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940718.756726:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788940718.756739:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788940718.756745:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1875839944901504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940718.756775:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1875839944901504:12345-0@lo:400:kworker.0 Request processed in 31us (5604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940718.756781:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788940718.756805:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944900480 00000100:00100000:2.0:1788940718.756811:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944900480 00000100:00100000:2.0:1788940718.756844:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944900224 00000100:00100000:2.0:1788940718.756847:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944900224 00000100:00100000:2.0:1788940718.756862:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788940718.756869:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944900480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940718.756904:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944900480:12345-0@lo:400:kworker.0 Request processed in 36us (5820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940718.756910:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788940718.756921:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788940718.756927:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944900224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940718.756977:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944900224:12345-0@lo:400:kworker.0 Request processed in 49us (5745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940718.756983:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788940718.757013:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944899968 00000100:00100000:2.0:1788940718.757017:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944899968 00000100:00100000:2.0:1788940718.757043:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1788940718.757050:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944899968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940718.757084:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944899968:12345-0@lo:400:kworker.0 Request processed in 35us (6056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940718.757090:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1788940718.759008:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944900224:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.762424:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00080000:1.0:1788940718.762495:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940718.762502:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940718.762507:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940718.762523:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788940718.762591:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944899968:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.762617:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944900480:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.762636:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944900992:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.762652:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944901504:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.762672:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944899840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940718.762687:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944900352:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.762700:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944900864:0@lo:400:kworker.0 00000100:00100000:1.0:1788940718.762714:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944901376:0@lo:400:kworker.0 00000100:00100000:2.0:1788940718.763154:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940718.763203:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921732608 00000100:00100000:2.0:1788940718.763212:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921732608 00000100:00100000:2.0:1788940718.763305:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 79 00000100:00100000:2.0:1788940718.763445:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+13:11349:x1875839921732608:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788940718.763545:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd705 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940718.763566:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd705 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940718.763583:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd705 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.769974:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd70c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.770013:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd70c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.770029:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd70c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.770081:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd713 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.770091:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd713 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.770099:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd713 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940718.770188:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788940718.770194:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788940718.770217:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd713 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.770233:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd705 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.770241:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd705 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.770249:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd705 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.772578:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940718.772597:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd705 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.772618:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd705 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.772932:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91cf07e67400) 00010000:00010000:1.0:1788940718.772937:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940718.772954:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd705 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.772963:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd705 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.772990:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd70c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.773015:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd70c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.773023:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd70c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.773029:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940718.773033:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd70c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.773040:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd70c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.773050:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff91cf06dfe000) 00010000:00010000:1.0:1788940718.773052:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940718.773055:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd70c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.773062:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd70c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.773089:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd713 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.773096:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd713 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.773102:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd713 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.773107:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940718.773119:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd713 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.773126:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd713 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.773135:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:1.0:1788940718.773138:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940718.773142:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd713 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.773149:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd713 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940718.773345:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+13:11349:x1875839921732608:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 Request processed in 9895us (10191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940718.773359:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 79 00000100:00100000:0.0:1788940718.779533:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940718.779632:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921732864 00000100:00100000:3.0:1788940718.779706:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921732864 00000100:00100000:3.0:1788940718.779882:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 80 00000100:00100000:3.0:1788940718.779897:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+13:11349:x1875839921732864:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940718.779927:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940718.779964:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd71a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc72fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.780112:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd721 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.780131:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd721 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.780146:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd721 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940718.780160:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788940718.780294:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd721 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.780302:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd721 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.780327:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd721 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.780334:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940718.780339:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd721 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.780347:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd721 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.780362:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:3.0:1788940718.780366:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940718.780372:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd721 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.780379:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd721 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.780430:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd71a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72fa expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.780441:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91cf07e67400) 00010000:00010000:3.0:1788940718.780444:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788940718.780448:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd71a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72fa expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.780458:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936200, rc 0) 00000100:00100000:3.0:1788940718.780542:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+14:11349:x1875839921732864:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 648us (1024us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1788940718.780557:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 80 00000100:00100000:0.0:1788940718.791085:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940718.794808:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921732992 00000100:00100000:1.0:1788940718.794835:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921732992 00000100:00100000:1.0:1788940718.794959:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 81 00000100:00100000:1.0:1788940718.794974:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+14:11349:x1875839921732992:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788940718.795045:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788940718.795278:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+14:11349:x1875839921732992:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 306us (4209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940718.795287:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 81 00000100:00100000:1.0:1788940718.800090:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940718.801029:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921733248 00000100:00100000:2.0:1788940718.801052:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921733248 00000100:00100000:2.0:1788940718.801136:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 82 00000100:00100000:2.0:1788940718.801147:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+14:11349:x1875839921733248:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940718.801173:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940718.801177:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788940718.801211:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd6db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72ec expref: 14 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940718.801293:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:2.0:1788940718.801300:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940718.801322:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd72f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7301 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788940718.802078:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788940718.802222:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd736 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940718.802236:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd736 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940718.802768:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd736 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940718.802963:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd72f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7301 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940718.803104:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd736 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7301 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940718.803113:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91d03ed37e00) 00010000:00010000:2.0:1788940718.803115:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940718.803119:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7c00, rc 0) 00000100:00100000:2.0:1788940718.803190:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+15:11349:x1875839921733248:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 2044us (3116us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788940718.803199:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 82 00000100:00100000:1.0:1788940718.812956:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940718.813233:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921733504 00000100:00100000:0.0:1788940718.813247:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921733504 00000100:00100000:0.0:1788940718.813365:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 83 00000100:00100000:0.0:1788940718.813379:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+15:11349:x1875839921733504:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788940718.813453:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940718.813485:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badd736 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7301 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813513:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91d03ed37e00) 00010000:00010000:0.0:1788940718.813527:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940718.813553:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badd744 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813567:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badd744 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813576:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badd744 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813589:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd74b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xee5b835e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813594:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd74b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xee5b835e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813610:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd74b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xee5b835e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813813:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badd744 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813819:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badd744 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813825:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badd744 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813829:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000030200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940718.813833:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badd744 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813839:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badd744 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813845:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:0.0:1788940718.813847:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940718.813850:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badd744 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813854:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badd744 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813864:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd74b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xee5b835e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813868:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd74b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xee5b835e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813881:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd74b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xee5b835e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813887:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940718.813889:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd74b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xee5b835e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813896:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd74b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xee5b835e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813904:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xee5b835e (ffff91d0421d1200) 00010000:00010000:0.0:1788940718.813907:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940718.813910:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd74b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xee5b835e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.813916:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd74b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xee5b835e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940718.814206:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+14:11349:x1875839921733504:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 827us (1271us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940718.814213:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 83 00000100:00100000:1.0:1788940718.818424:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940718.818467:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921733632 00000100:00100000:1.0:1788940718.818483:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921733632 00000100:00100000:1.0:1788940718.818536:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 84 00000100:00100000:1.0:1788940718.818546:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+14:11349:x1875839921733632:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940718.818570:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940718.818655:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd752 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7308 expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.818699:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd759 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.818714:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd759 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.818729:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd759 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.820045:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd752 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7308 expref: 16 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.820071:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd759 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7308 expref: 15 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.820080:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91cf06dfe000) 00010000:00010000:1.0:1788940718.820083:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788940718.820086:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603800, rc 0) 00000100:00100000:1.0:1788940718.820152:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+15:11349:x1875839921733632:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1606us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940718.820161:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 84 00000100:00100000:1.0:1788940718.832096:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940718.832152:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921733888 00000100:00100000:1.0:1788940718.832163:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921733888 00000100:00100000:1.0:1788940718.832216:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 85 00000100:00100000:1.0:1788940718.832227:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+15:11349:x1875839921733888:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788940718.832341:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd760 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.832360:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd760 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.832374:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd760 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940718.832558:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788940718.832570:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 474165312225ns, next at 475165309288ns, rc = 0 00000004:00010000:1.0:1788940718.832624:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002c0a7ce reply state 000000004829653a transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd760 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.832639:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd760 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940718.832646:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91cf06dfe000) 00010000:00010000:1.0:1788940718.832650:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788940718.832654:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940718.832752:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+17:11349:x1875839921733888:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 527us (666us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788940718.832761:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 85 00000040:00080000:3.0:1788940718.838352:0:14216:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940718.838365:0:14216:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940718.838397:0:14216:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788940718.838406:0:14216:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788940718.840383:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940718.841011:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921734016 00000100:00100000:0.0:1788940718.841023:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921734016 00000100:00100000:0.0:1788940718.841188:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 86 00000100:00100000:0.0:1788940718.841202:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+17:11349:x1875839921734016:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940718.841230:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940718.841368:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd767 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc730f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.841444:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd767 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc730f expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.841461:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd767 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc730f expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.841553:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91cf06dfe000) 00010000:00010000:0.0:1788940718.841557:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788940718.841561:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d000031600, rc 0) 00000100:00100000:0.0:1788940718.841635:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+18:11349:x1875839921734016:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 433us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940718.841643:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 86 00000100:00100000:1.0:1788940718.845070:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940718.845144:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921734144 00000100:00100000:2.0:1788940718.845156:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921734144 00000100:00100000:2.0:1788940718.845212:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:2.0:1788940718.845225:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1875839921734144:12345-192.168.202.25@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788940718.845288:0:8437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:2.0:1788940718.845344:0:8437:0:(genops.c:1393:class_connect()) connect: client 82f3b232-46da-4a78-8599-45df2ddbced0, cookie 0x9c34acc08badd76e 00002000:00100000:2.0:1788940718.845361:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 82f3b232-46da-4a78-8599-45df2ddbced0/ffff91cf01ac3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788940718.845397:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:2.0:1788940718.845497:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788940718.845535:0:8437:0:(import.c:65:import_set_state_nolock()) ffff91cf01ac4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940718.845650:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2403:x1875839921734144:12345-192.168.202.25@tcp:8:lhsmtool_posix.0 Request processed in 425us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940718.845659:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:1.0:1788940718.848755:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940718.849039:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921734272 00000100:00100000:2.0:1788940718.849050:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921734272 00000100:00100000:2.0:1788940718.849150:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00100000:2.0:1788940718.849162:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:0:x1875839921734272:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788940718.849385:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788940718.851442:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:2.0:1788940718.851466:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 82f3b232-46da-4a78-8599-45df2ddbced0 00000100:00100000:3.0:1788940718.852426:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:0:x1875839921734272:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 3255us (3669us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788940718.852441:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00100000:2.0:1788940718.880238:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940718.880414:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921734528 00000100:00100000:3.0:1788940718.880426:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921734528 00000100:00100000:3.0:1788940718.880505:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:3.0:1788940718.880516:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+18:11349:x1875839921734528:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788940718.880773:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+19:11349:x1875839921734528:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 259us (543us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788940718.880781:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:0.0:1788940718.912080:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940718.912321:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921734784 00000100:00100000:0.0:1788940718.912331:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921734784 00000100:00100000:0.0:1788940718.912403:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 87 00000100:00100000:0.0:1788940718.912416:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+19:11349:x1875839921734784:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788940718.912546:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+19:11349:x1875839921734784:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 132us (3480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940718.912554:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 87 00000100:00100000:2.0:1788940718.920108:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940718.920690:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921734912 00000100:00100000:3.0:1788940718.920701:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921734912 00000100:00100000:3.0:1788940718.920764:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 88 00000100:00100000:3.0:1788940718.920775:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+19:11349:x1875839921734912:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940718.920893:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940718.920917:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd775 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7316 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.921004:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd77c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.921042:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd77c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.921056:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd77c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940718.921114:0:8517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940718.921136:0:8517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd77c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.921165:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd775 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7316 expref: 21 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.921184:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd77c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7316 expref: 20 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.921192:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91cf06dfe000) 00010000:00010000:3.0:1788940718.921195:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788940718.921199:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936800, rc 0) 00000100:00100000:3.0:1788940718.921417:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+20:11349:x1875839921734912:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 643us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940718.921426:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 88 00000100:00100000:0.0:1788940718.925810:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940718.926708:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921735040 00000100:00100000:2.0:1788940718.926720:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921735040 00000100:00100000:2.0:1788940718.926778:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 35 00000100:00100000:2.0:1788940718.926788:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921735040:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940718.926828:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940718.926851:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4f2e6d6/0x9c34acc08badd783 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc731d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788940718.926876:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa111af, blocks: 0x0 00010000:00010000:2.0:1788940718.926897:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788940718.926902:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940718.926912:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f2e6d6/0x9c34acc08badd783 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc731d expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940718.926933:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4f2e6d6/0x9c34acc08badd783 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc731d expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940718.926956:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6c00, rc 0) 00000100:00100000:2.0:1788940718.927020:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921735040:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 233us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940718.927027:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 35 00000100:00100000:2.0:1788940718.931386:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940718.931503:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921735296 00000100:00100000:1.0:1788940718.931513:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921735296 00000100:00100000:1.0:1788940718.931573:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 89 00000100:00100000:1.0:1788940718.931584:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+20:11349:x1875839921735296:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788940718.931702:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+20:11349:x1875839921735296:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 120us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940718.931710:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 89 00000100:00100000:0.0:1788940718.934877:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940718.934955:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921735424 00000100:00100000:3.0:1788940718.934966:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921735424 00000100:00100000:3.0:1788940718.935027:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:3.0:1788940718.935038:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:11349:x1875839921735424:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940718.935057:0:8524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940718.935083:0:8524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badd78a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7324 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.935116:0:8524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4f2e6d6/0x9c34acc08badd783 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc731d expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.935125:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940718.935130:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940718.935136:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badd78a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7324 expref: 7 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.935170:0:8524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4f2e6d6/0x9c34acc08badd783 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc731d expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.935185:0:8524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4f2e6d6/0x9c34acc08badd783 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc731d expref: 7 pid: 8437 timeout: 574 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940718.935199:0:8524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8524:1875839944901760:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788940718.935319:0:8524:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0207fbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940718.943329:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940718.946389:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921735552 00000100:00100000:0.0:1788940718.946405:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921735552 00010000:00010000:0.0:1788940718.946455:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f2e6d6/0x9c34acc08badd783 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc731d expref: 8 pid: 8437 timeout: 574 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940718.946511:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:0.0:1788940718.946522:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+8:2405:x1875839921735552:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940718.946538:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940718.946564:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4f2e6d6/0x9c34acc08badd783 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc731d expref: 8 pid: 8437 timeout: 574 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.946583:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4f2e6d6/0x9c34acc08badd783 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc731d expref: 8 pid: 8437 timeout: 574 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.946614:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940718.946619:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940718.946630:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badd78a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7324 expref: 8 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.946642:0:7474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badd78a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7324 expref: 8 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940718.946686:0:7474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badd78a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7324 expref: 8 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940718.946701:0:7474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7474:1875839944901888:192.168.202.25@tcp:105: 00000100:00100000:0.0:1788940718.946789:0:7474:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0358d86c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788940718.947240:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4f2e6d6/0x9c34acc08badd783 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc731d expref: 8 pid: 8437 timeout: 574 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940718.947352:0:8524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8524:1875839944901760:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940718.947379:0:8524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badd78a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7324 expref: 7 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940718.947406:0:8524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936200, rc 0) 00000100:00100000:3.0:1788940718.947452:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+7:11349:x1875839921735424:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 12416us (12585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940718.947460:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:0.0:1788940718.957594:0:7474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7474:1875839944901888:192.168.202.25@tcp:105: 00010000:00010000:0.0:1788940718.957629:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940718.957785:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:2405:x1875839921735552:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 11263us (14462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940718.957806:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:0.0:1788940718.959058:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940718.959118:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921735680 00000100:00100000:3.0:1788940718.959126:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921735680 00002000:00100000:3.0:1788940718.959168:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff91d020afad80 x1875839921735680/t0(0) o4->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:694/0 lens 504/0 e 0 to 0 dl 1788940729 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788940718.959179:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91d020afad80 with x1875839921735680 ext(0->8) 00002000:00010000:3.0:1788940718.959184:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d020afad80 00000100:00100000:3.0:1788940718.959211:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:3.0:1788940718.959218:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921735680:12345-192.168.202.25@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788940718.972127:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82f3b232-46da-4a78-8599-45df2ddbced0+8:2404:x1875839921735680:12345-192.168.202.25@tcp:4:lhsmtool_posix.0 Request processed in 12898us (13063us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788940718.972150:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 0 00002000:00100000:2.0:1788940718.972164:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff91d020afad80 x1875839921735680/t4294967303(0) o4->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:694/0 lens 504/448 e 0 to 0 dl 1788940729 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788940718.972175:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91d020afad80 with x1875839921735680 ext(0->8) 00002000:00010000:2.0:1788940718.972190:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d020afad80 00000100:00100000:2.0:1788940718.992672:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940719.001328:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921735808 00000100:00100000:3.0:1788940719.001345:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921735808 00000100:00100000:3.0:1788940719.001420:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 90 00000100:00100000:3.0:1788940719.001433:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+20:11349:x1875839921735808:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788940719.011193:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1788940719.011214:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788940719.011240:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1788940719.011283:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788940719.011293:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788940719.011429:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+15:11349:x1875839921735808:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 Request processed in 9993us (18761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940719.011439:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 90 00000100:00100000:2.0:1788940719.012017:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00d26d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944902016:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788940719.012081:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940719.012160:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944902016 00000100:00100000:2.0:1788940719.012169:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944902016 00000100:00100000:2.0:1788940719.012222:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788940719.012235:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944902016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788940719.012411:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788940719.012415:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788940719 00002000:00010000:2.0:1788940719.012417:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788940719.012420:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788940719 -> 1788940719 00002000:00010000:2.0:1788940719.012422:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788940719.012458:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875839944902016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 225us (376us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788940719.012466:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1788940719.012523:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d00d26d880/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788940719.012531:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00d26d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944902016:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788940719.013130:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd760 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.013144:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd760 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.013151:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd760 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.013157:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940719.013162:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd760 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.013171:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd760 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.013188:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91cf06dfe000) 00010000:00010000:1.0:1788940719.013191:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788940719.013208:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd760 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.013215:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd760 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940719.023819:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940719.023859:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921735936 00000100:00100000:0.0:1788940719.023868:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921735936 00000100:00100000:0.0:1788940719.024414:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 38 00000100:00100000:0.0:1788940719.024427:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+8:2406:x1875839921735936:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788940719.026139:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1788940719.026156:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1788940719.027227:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:2406:x1875839921735936:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 Request processed in 2793us (3407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940719.027241:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 38 00000100:00100000:0.0:1788940719.036041:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940719.038184:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921736192 00000100:00100000:1.0:1788940719.038198:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921736192 00000100:00080000:2.0:1788940719.038337:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940719.038385:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 91 00000100:00100000:1.0:1788940719.038396:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+14:11349:x1875839921736192:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788940719.038453:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940719.038481:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd77c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7316 expref: 14 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.038497:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91cf06dfe000) 00010000:00010000:1.0:1788940719.038502:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940719.038531:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd791 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.038546:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd791 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.038556:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd791 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940719.038681:0:8517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080ca4e38 reply state 00000000823b5411 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd791 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.038693:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd791 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.038718:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91cf06dfe000) 00010000:00010000:1.0:1788940719.038721:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788940719.038723:0:8517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940719.038830:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+15:11349:x1875839921736192:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 436us (2799us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1788940719.038838:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 91 00000100:00100000:0.0:1788940719.044652:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940719.045914:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921736320 00000100:00100000:2.0:1788940719.045927:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921736320 00000100:00100000:3.0:1788940719.046212:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00100000:3.0:1788940719.046225:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2405:x1875839921736320:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788940719.046411:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788940719.046415:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788940719 -> 1788940718 00002000:00010000:3.0:1788940719.046417:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788940716 00002000:00010000:3.0:1788940719.046419:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788940719 -> 1788940718 00002000:00010000:3.0:1788940719.046422:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788940719.046497:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921736320:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 273us (1855us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788940719.047019:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00100000:2.0:1788940719.048956:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940719.049030:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921736576 00000100:00100000:1.0:1788940719.049040:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921736576 00000100:00100000:1.0:1788940719.049125:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 92 00000100:00100000:1.0:1788940719.049136:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+15:11349:x1875839921736576:12345-192.168.202.25@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788940719.049215:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd798 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.049234:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd759 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7308 expref: 15 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.049244:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd798 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.049328:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd759 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7308 expref: 15 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.049345:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd759 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7308 expref: 15 pid: 9713 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940719.049360:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c99500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944902144:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940719.049445:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940719.057503:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c99500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944902144:192.168.202.25@tcp:104: 00010000:00010000:0.0:1788940719.057535:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd798 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940719.060123:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940719.062129:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921736704 00000100:00100000:0.0:1788940719.062146:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921736704 00010000:00010000:0.0:1788940719.062199:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd759 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7308 expref: 16 pid: 9713 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940719.062403:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 60 00000100:00100000:0.0:1788940719.062418:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+16:2405:x1875839921736704:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940719.062435:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940719.062442:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd759 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7308 expref: 16 pid: 9713 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.062477:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd759 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7308 expref: 16 pid: 9713 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.062502:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd759 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7308 expref: 16 pid: 9713 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.062521:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91cf06dfe000) 00010000:00010000:0.0:1788940719.062527:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd798 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.062537:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd798 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.062546:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd798 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.062587:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940719.062654:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+15:2405:x1875839921736704:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 240us (2620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940719.062662:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 60 00010000:00010000:2.0:1788940719.062715:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd798 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.062723:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd798 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.062774:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd798 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.062781:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd798 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.062788:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd798 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.062807:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940719.062812:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd798 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.062819:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd798 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.062830:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91cf06dfe000) 00010000:00010000:2.0:1788940719.062833:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788940719.062837:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd798 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.062843:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd798 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940719.062886:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+14:11349:x1875839921736576:12345-192.168.202.25@tcp:55:lhsmtool_posix.0 Request processed in 13752us (13946us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788940719.062894:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 92 00000100:00100000:0.0:1788940719.069702:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940719.069735:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921736832 00000100:00100000:0.0:1788940719.069745:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921736832 00000100:00100000:0.0:1788940719.069809:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:0.0:1788940719.069820:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921736832:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788940719.069878:0:8524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363cf4d7/0x9c34acc08badd79f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.069922:0:8524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badd78a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7324 expref: 7 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.069931:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940719.069936:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940719.069951:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363cf4d7/0x9c34acc08badd79f lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.069993:0:8524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badd78a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7324 expref: 7 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.070009:0:8524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badd78a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7324 expref: 7 pid: 8524 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940719.070027:0:8524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8524:1875839944902272:192.168.202.25@tcp:104: 00000100:00100000:0.0:1788940719.070496:0:8524:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0358d86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940719.080429:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940719.080659:0:8524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8524:1875839944902272:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940719.080674:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921736960 00000100:00100000:1.0:1788940719.080682:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921736960 00010000:00010000:3.0:1788940719.080697:0:8524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000363cf4d7/0x9c34acc08badd79f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.080717:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badd78a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7324 expref: 8 pid: 8524 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940719.080758:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 61 00000100:00100000:1.0:1788940719.080768:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+8:2404:x1875839921736960:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940719.080784:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940719.080807:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badd78a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7324 expref: 8 pid: 8524 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.080819:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badd78a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7324 expref: 8 pid: 8524 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.080847:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badd78a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7324 expref: 8 pid: 8524 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.080864:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788940719.080869:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788940719.080874:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000363cf4d7/0x9c34acc08badd79f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.080896:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363cf4d7/0x9c34acc08badd79f lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.080927:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940719.080998:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:2404:x1875839921736960:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 230us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940719.081019:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 61 00010000:00010000:0.0:1788940719.081463:0:8524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000363cf4d7/0x9c34acc08badd79f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.081473:0:8524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363cf4d7/0x9c34acc08badd79f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.081494:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000363cf4d7/0x9c34acc08badd79f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.081523:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363cf4d7/0x9c34acc08badd79f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.081530:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363cf4d7/0x9c34acc08badd79f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.081537:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000030e00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940719.081542:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363cf4d7/0x9c34acc08badd79f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.081550:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363cf4d7/0x9c34acc08badd79f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.081563:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363cf4d7/0x9c34acc08badd79f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.081571:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363cf4d7/0x9c34acc08badd79f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940719.081639:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:2405:x1875839921736832:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 Request processed in 11820us (11947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940719.081648:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:0.0:1788940719.087499:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940719.091280:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921737216 00000100:00100000:3.0:1788940719.091301:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921737216 00000100:00100000:2.0:1788940719.091522:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 93 00000100:00100000:2.0:1788940719.091538:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+14:11349:x1875839921737216:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788940719.091664:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd7a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.091683:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd5e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72ad expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.091692:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd7a6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.091729:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72ad expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.091742:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd5e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72ad expref: 14 pid: 6520 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940719.091758:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00d26f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875839944902400:192.168.202.25@tcp:104: 00000100:00100000:2.0:1788940719.091882:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03598a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788940719.096396:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00d26f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875839944902400:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940719.096428:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd7a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940719.096582:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940719.096811:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921737344 00000100:00100000:3.0:1788940719.096819:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921737344 00010000:00010000:3.0:1788940719.096859:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd5e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72ad expref: 15 pid: 6520 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940719.096921:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 62 00000100:00100000:3.0:1788940719.096932:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050d8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+15:2404:x1875839921737344:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940719.096959:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940719.096967:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd5e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72ad expref: 15 pid: 6520 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940719.096980:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72ad expref: 15 pid: 6520 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940719.097009:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd5e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72ad expref: 15 pid: 6520 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940719.097025:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:3.0:1788940719.097030:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd7a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940719.097039:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940719.097226:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd7a6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940719.097301:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940719.097363:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050d8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+14:2404:x1875839921737344:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 431us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940719.097371:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 62 00010000:00010000:2.0:1788940719.097669:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.097678:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.097920:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd7ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.097934:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd767 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc730f expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.097969:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd7ad lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.098001:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd767 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc730f expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.098014:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd767 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc730f expref: 14 pid: 6522 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940719.098029:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00d26ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875839944902528:192.168.202.25@tcp:104: 00000100:00100000:2.0:1788940719.098193:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050eab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940719.106209:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940719.106371:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921737472 00000100:00100000:1.0:1788940719.106382:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921737472 00010000:00010000:1.0:1788940719.106423:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd767 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc730f expref: 15 pid: 6522 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940719.106441:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00d26ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875839944902528:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940719.106472:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 63 00010000:00010000:3.0:1788940719.106479:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd7ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940719.106481:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+15:2405:x1875839921737472:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940719.106495:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940719.106502:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd767 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc730f expref: 15 pid: 6522 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.106515:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd767 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc730f expref: 15 pid: 6522 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.106538:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badd767 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc730f expref: 15 pid: 6522 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.106554:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91cf06dfe000) 00010000:00010000:1.0:1788940719.106559:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd7ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.106569:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd7ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.106577:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd7ad lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940719.106628:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940719.106691:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+14:2405:x1875839921737472:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 209us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940719.106699:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 63 00010000:00010000:3.0:1788940719.107135:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd7ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940719.107143:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd7ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940719.109045:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1788940719.109214:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1788940719.109250:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1788940719.109428:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00d26ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1875839944902656:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788940719.109496:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940719.110168:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06f4e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940719.110940:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944902656 00000100:00100000:1.0:1788940719.110960:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944902656 00000100:00100000:1.0:1788940719.111059:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788940719.111069:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1875839944902656:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788940719.111183:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1875839944902656:12345-0@lo:1000:mdt00_000.0 Request processed in 115us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940719.111190:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788940719.111251:0:6520:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788940719.111275:0:6520:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d00d26d880, transno 4294967304 00000100:00100000:2.0:1788940719.111291:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00d26ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1875839944902656:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788940719.111457:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788940719.111529:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00d26ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1875839944902784:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788940719.111560:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940719.112550:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06f4e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788940719.112838:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944902784 00000100:00100000:0.0:1788940719.112856:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944902784 00000100:00100000:0.0:1788940719.112959:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788940719.112968:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1875839944902784:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788940719.113152:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6520:x1875839944902784:12345-0@lo:1000:mdt00_000.0 Request processed in 185us (1590us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788940719.113160:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788940719.113304:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00d26ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1875839944902784:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788940719.113473:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd7ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.113484:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd7ad lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.113492:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd7ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.113498:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940719.113513:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd7ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.113522:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd7ad lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.113537:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91cf06dfe000) 00010000:00010000:2.0:1788940719.113541:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940719.113546:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd7ad lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.113553:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd7ad lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.113594:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd6e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.113601:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd6e2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.113606:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd6e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.113621:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940719.113624:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd6e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.113629:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd6e2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.113637:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:2.0:1788940719.113639:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940719.113642:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd6e2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.113648:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd6e2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.113672:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd7b4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.113686:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd6fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72f3 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.113695:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd7b4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.113723:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd6fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72f3 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.113736:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd6fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72f3 expref: 17 pid: 6520 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940719.113968:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00d26e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875839944902912:192.168.202.25@tcp:104: 00000100:00100000:2.0:1788940719.114041:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06f4e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788940719.116715:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940719.116779:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921737600 00000100:00100000:3.0:1788940719.116796:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921737600 00000100:00100000:0.0:1788940719.116848:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00d26e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875839944902912:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940719.116865:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd6fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72f3 expref: 18 pid: 6520 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940719.116921:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:3.0:1788940719.116933:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+18:2404:x1875839921737600:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940719.116973:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940719.116982:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd6fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72f3 expref: 18 pid: 6520 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.116998:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd7b4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940719.117115:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd6fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72f3 expref: 18 pid: 6520 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940719.119133:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd6fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc72f3 expref: 18 pid: 6520 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940719.119163:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:3.0:1788940719.119170:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd7b4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940719.119202:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd7b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940719.119212:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd7b4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940719.119874:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940719.119978:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd7b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.119995:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd7b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.120011:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd7b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.120018:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd7b4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.120025:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd7b4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.120031:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940719.120035:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd7b4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.120044:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd7b4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.120072:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:0.0:1788940719.120075:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940719.120080:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd7b4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.120087:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd7b4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.120102:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.120109:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd7a6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.120115:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd7a6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.120120:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940719.120123:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd7a6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.120129:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd7a6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.120136:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91cf06dfea00) 00010000:00010000:0.0:1788940719.120139:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788940719.120142:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd7a6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.120147:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd7a6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788940719.122275:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940719.122281:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940719.122326:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788940719.122334:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788940719.123551:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+17:2404:x1875839921737600:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 6611us (6834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940719.123563:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:0.0:1788940719.124070:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+16:11349:x1875839921737216:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 32535us (36579us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788940719.124080:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 93 00000020:00080000:0.0:1788940719.124085:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788940719.128352:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940719.128479:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921737856 00000100:00100000:3.0:1788940719.128567:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921737856 00000100:00100000:3.0:1788940719.128659:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:3.0:1788940719.128754:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+16:11349:x1875839921737856:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788940719.130232:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788940719.130384:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1788940719.130445:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd7bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940719.130469:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd7bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940719.130486:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd7bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940719.130496:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd7bb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940719.130932:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd7bb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940719.130950:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd7bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940719.131635:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788940719.132297:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+18:11349:x1875839921737856:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 3536us (3945us total) trans 4294967364 rc 0/0 00010000:00010000:0.0:1788940719.132460:0:10401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940719.132478:0:10401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd7bb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.132490:0:10401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936600 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940719.132495:0:10401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd7bb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.132506:0:10401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd7bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.132529:0:10401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91cf06dfe000) 00010000:00010000:0.0:1788940719.132532:0:10401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788940719.132539:0:10401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd7bb lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.132546:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd7bb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940719.132569:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940719.132571:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940719.132573:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940719.142729:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 20 00000020:00080000:3.0:1788940719.142748:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788940719.387558:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940720.411407:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940721.019808:0:14267:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940721.019822:0:14267:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940721.019854:0:14267:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788940721.019861:0:14267:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788940721.190631:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940721.190808:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921738112 00000100:00100000:3.0:1788940721.190826:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921738112 00000100:00100000:3.0:1788940721.190944:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 94 00000100:00100000:3.0:1788940721.190959:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+18:11368:x1875839921738112:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940721.190994:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940721.191025:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd7c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc732b expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.191202:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937400/0x9c34acc08badd7c9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.191223:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937400/0x9c34acc08badd7c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.191243:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937400/0x9c34acc08badd7c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940721.191295:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788940721.191440:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd7c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc732b expref: 21 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.191464:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937400/0x9c34acc08badd7c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc732b expref: 20 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.191473:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:3.0:1788940721.191631:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788940721.191636:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937400, rc 0) 00000100:00100000:3.0:1788940721.191732:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+20:11368:x1875839921738112:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 776us (1117us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788940721.191741:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 94 00000100:00080000:1.0:1788940721.192303:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940721.198896:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940721.201439:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921738240 00000100:00100000:2.0:1788940721.201463:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921738240 00000100:00100000:2.0:1788940721.201561:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 95 00000100:00100000:2.0:1788940721.201575:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+20:11368:x1875839921738240:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:2.0:1788940721.201690:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7d7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.201716:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.201732:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.201753:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.201761:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.201768:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.201896:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd7e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.201905:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.201913:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940721.201997:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202014:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202021:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7d7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202029:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202036:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940721.202042:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202051:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202065:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:2.0:1788940721.202069:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940721.202075:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202089:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202105:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202111:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202117:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202122:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940721.202125:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202132:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202140:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d00293a700) 00010000:00010000:2.0:1788940721.202142:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940721.202146:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202152:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202171:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202176:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd7e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202188:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202193:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940721.202196:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202202:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd7e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202210:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d00293af00) 00010000:00010000:2.0:1788940721.202212:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940721.202215:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd7e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.202220:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd7e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940721.202369:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+20:11368:x1875839921738240:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 797us (3488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940721.202378:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 95 00000100:00100000:3.0:1788940721.269454:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940721.269689:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921738496 00000100:00100000:2.0:1788940721.269704:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921738496 00000100:00100000:2.0:1788940721.269777:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 96 00000100:00100000:2.0:1788940721.269788:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+20:11371:x1875839921738496:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1788940721.269824:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940721.269855:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd7ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7332 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270000:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7f3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270021:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270036:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270052:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270059:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270067:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270242:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd801 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270251:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270295:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940721.270308:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788940721.270413:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270420:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7f3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270437:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7f3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270444:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940721.270448:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7f3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270457:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7f3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270471:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:2.0:1788940721.270474:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940721.270614:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270624:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badd7f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270639:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270646:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270651:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270656:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940721.270660:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270676:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270685:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d00293af00) 00010000:00010000:2.0:1788940721.270687:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940721.270691:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270697:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd7fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270754:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd7ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7332 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270769:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd801 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7332 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.270777:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d00293a700) 00010000:00010000:2.0:1788940721.270779:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940721.270781:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6800, rc 0) 00000100:00100000:2.0:1788940721.270873:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+22:11371:x1875839921738496:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 1086us (1437us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788940721.270884:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 96 00000100:00100000:1.0:1788940721.277191:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940721.277491:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921738624 00000100:00100000:0.0:1788940721.277506:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921738624 00000100:00100000:0.0:1788940721.277594:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 97 00000100:00100000:0.0:1788940721.277608:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+22:11371:x1875839921738624:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:0.0:1788940721.277883:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd80f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.277906:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd80f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.277935:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd80f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.277985:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd80f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.277993:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd80f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.278002:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd80f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.278009:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000030e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940721.278014:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd80f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.278024:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd80f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.278057:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d00293a700) 00010000:00010000:0.0:1788940721.278061:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940721.278067:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd80f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.278075:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd80f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940721.278227:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+22:11371:x1875839921738624:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 619us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940721.278236:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 97 00000100:00100000:0.0:1788940721.299487:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940721.299542:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921738880 00000100:00100000:0.0:1788940721.299557:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921738880 00000100:00100000:0.0:1788940721.299634:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:0.0:1788940721.299754:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d002e67850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+22:11371:x1875839921738880:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1788940721.300087:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d002e67850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+23:11371:x1875839921738880:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 442us (616us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1788940721.300095:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:3.0:1788940721.314144:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940721.314175:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944903040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940721.314448:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940721.315545:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944903040 00000100:00100000:1.0:1788940721.315565:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944903040 00000100:00100000:1.0:1788940721.315793:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788940721.315806:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944903040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788940721.315866:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788940721.316169:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944903040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 365us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940721.316179:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788940721.316334:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944903040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940721.346752:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940721.346845:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921739136 00000100:00100000:2.0:1788940721.346858:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921739136 00000100:00100000:2.0:1788940721.346940:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 98 00000100:00100000:2.0:1788940721.346953:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+23:10889:x1875839921739136:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1788940721.346997:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940721.347026:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd816 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7339 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.347216:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd81d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.347235:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd801 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7332 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.347245:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd81d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.347412:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd801 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7332 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.347427:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd801 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7332 expref: 24 pid: 6520 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940721.347444:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00d26ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875839944903168:192.168.202.25@tcp:104: 00000100:00100000:2.0:1788940721.348490:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03598a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788940721.357469:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00d26ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875839944903168:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940721.357522:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd81d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940721.358105:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940721.358411:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921739264 00000100:00100000:2.0:1788940721.358422:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921739264 00010000:00010000:2.0:1788940721.358488:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd801 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7332 expref: 25 pid: 6520 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940721.358542:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:2.0:1788940721.358552:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08549500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+25:2404:x1875839921739264:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940721.358587:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940721.358595:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd801 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7332 expref: 25 pid: 6520 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.358611:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd801 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7332 expref: 25 pid: 6520 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.358639:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd801 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7332 expref: 25 pid: 6520 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.358761:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d00293a700) 00010000:00010000:2.0:1788940721.358767:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd81d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.358779:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd81d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.358788:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd81d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.358820:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940721.358889:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08549500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+24:2404:x1875839921739264:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 337us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940721.358897:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 65 00010000:00010000:2.0:1788940721.358943:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd81d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.358952:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd81d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940721.358991:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788940721.359182:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08badd816 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7339 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.359200:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd81d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7339 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.359209:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d00293a700) 00010000:00010000:2.0:1788940721.359211:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788940721.359214:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6c00, rc 0) 00000100:00100000:2.0:1788940721.359242:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+24:10889:x1875839921739136:12345-192.168.202.25@tcp:101:bash.0 Request processed in 12292us (12504us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1788940721.359251:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 98 00000100:00100000:2.0:1788940721.366884:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940721.366972:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921739392 00000100:00100000:3.0:1788940721.366987:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921739392 00000100:00100000:3.0:1788940721.367062:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 99 00000100:00100000:3.0:1788940721.367074:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+24:10889:x1875839921739392:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1788940721.367105:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940721.367132:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd82b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7340 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.367180:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd832 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.367218:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd832 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.367233:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd832 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.368426:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badd82b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7340 expref: 26 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.368451:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd832 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7340 expref: 25 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.368460:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d00293a700) 00010000:00010000:0.0:1788940721.368463:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788940721.368475:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936200, rc 0) 00000100:00100000:0.0:1788940721.368556:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+25:10889:x1875839921739392:12345-192.168.202.25@tcp:101:bash.0 Request processed in 1483us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940721.368564:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 99 00000100:00100000:2.0:1788940721.376140:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940721.376575:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921739648 00000100:00100000:0.0:1788940721.376589:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921739648 00000100:00100000:0.0:1788940721.376679:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 100 00000100:00100000:0.0:1788940721.376691:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+25:10889:x1875839921739648:12345-192.168.202.25@tcp:36:bash.0 00010000:00010000:0.0:1788940721.377044:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd839 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.377071:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd839 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.377085:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd839 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940721.377143:0:9713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1788940721.377167:0:9713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006863d7ad reply state 00000000038b5521 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd839 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.377183:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd839 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.377190:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d00293a700) 00010000:00010000:0.0:1788940721.377193:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788940721.377199:0:9713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788940721.377237:0:9713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1788940721.377400:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+29:10889:x1875839921739648:12345-192.168.202.25@tcp:36:bash.0 Request processed in 710us (1276us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788940721.377409:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 100 00000020:00080000:0.0:1788940721.377432:0:9713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788940721.379870:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940721.379998:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921739776 00000100:00100000:2.0:1788940721.380015:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921739776 00000100:00100000:2.0:1788940721.380089:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 101 00000100:00100000:2.0:1788940721.380100:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+29:10889:x1875839921739776:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1788940721.380134:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940721.380159:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd840 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7347 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.380234:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd840 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7347 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.380321:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd840 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7347 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.380345:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d00293a700) 00010000:00010000:2.0:1788940721.380349:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940721.380354:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6800, rc 0) 00000100:00100000:2.0:1788940721.380438:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+30:10889:x1875839921739776:12345-192.168.202.25@tcp:101:bash.0 Request processed in 339us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940721.380448:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 101 00000100:00100000:2.0:1788940721.383231:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940721.390409:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921739904 00000100:00100000:1.0:1788940721.390435:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921739904 00000100:00080000:2.0:1788940721.390656:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940721.391239:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 41 00000100:00100000:1.0:1788940721.391283:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035df2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+6:10889:x1875839921739904:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:1.0:1788940721.391310:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940721.391343:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0a91b69/0x9c34acc08badd847 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc734e expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940721.391378:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa111ae, atime: 0x6aa111ac, ctime: 0x6aa111ae, blocks: 0x8 00010000:00010000:1.0:1788940721.391411:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788940721.391416:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940721.391427:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a91b69/0x9c34acc08badd847 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc734e expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.391450:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e0a91b69/0x9c34acc08badd847 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc734e expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.391466:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603600, rc 0) 00000100:00100000:1.0:1788940721.391577:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035df2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:10889:x1875839921739904:12345-192.168.202.25@tcp:101:bash.0 Request processed in 327us (8360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940721.391586:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 41 00000100:00100000:0.0:1788940721.404823:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940721.404991:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921740032 00000100:00100000:3.0:1788940721.405006:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921740032 00002000:00010000:3.0:1788940721.405065:0:8442:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1788940721.405070:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91d020afa300 with x1875839921740032 ext(0->18446744073709551615) 00002000:00010000:3.0:1788940721.405085:0:8442:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d020afa300. 00000100:00100000:3.0:1788940721.405134:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:3.0:1788940721.405146:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82f3b232-46da-4a78-8599-45df2ddbced0+7:2407:x1875839921740032:12345-192.168.202.25@tcp:10:bash.0 00002000:00010000:3.0:1788940721.405558:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788940721.405563:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788940718 -> 1788940722 00002000:00010000:3.0:1788940721.405566:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788940716 -> 1788940716 00002000:00010000:3.0:1788940721.405568:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788940718 -> 1788940722 00002000:00010000:3.0:1788940721.405571:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788940721.405652:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82f3b232-46da-4a78-8599-45df2ddbced0+8:2407:x1875839921740032:12345-192.168.202.25@tcp:10:bash.0 Request processed in 506us (842us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788940721.405662:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 1 00002000:00010000:3.0:1788940721.405667:0:8442:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1788940721.405670:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91d020afa300 with x1875839921740032 ext(0->18446744073709551615) 00002000:00010000:3.0:1788940721.405675:0:8442:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d020afa300. 00010000:00010000:0.0:1788940721.435683:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940721.449170:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940721.449299:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921740160 00000100:00100000:3.0:1788940721.449333:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921740160 00000100:00100000:3.0:1788940721.449411:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 395 00000100:00100000:3.0:1788940721.449425:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2405:x1875839921740160:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940721.449538:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2405:x1875839921740160:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 115us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940721.449547:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 395 00000100:00100000:2.0:1788940721.452308:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940721.452353:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940721.452390:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940721.452438:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940721.452654:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921740672 00000100:00100000:1.0:1788940721.452670:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921740672 00000100:00100000:1.0:1788940721.452753:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921740288 00000100:00100000:1.0:1788940721.452757:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921740288 00000100:00100000:1.0:1788940721.452778:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921740544 00000100:00100000:1.0:1788940721.452780:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921740544 00000100:00100000:1.0:1788940721.452803:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 347 00000100:00100000:1.0:1788940721.452815:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921740672:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940721.452963:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921740672:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 150us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940721.452972:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 347 00000100:00100000:1.0:1788940721.452994:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 348 00000100:00100000:1.0:1788940721.453000:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921740288:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940721.453026:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921740288:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 26us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940721.453032:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 348 00000100:00100000:1.0:1788940721.453043:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 349 00000100:00100000:1.0:1788940721.453049:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921740544:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940721.453072:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921740544:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 23us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940721.453079:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 349 00000100:00080000:2.0:1788940721.453698:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940721.453705:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788940721.453781:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921740416 00000100:00100000:0.0:1788940721.453791:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921740416 00000100:00100000:0.0:1788940721.453866:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 130 00000100:00100000:0.0:1788940721.453876:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921740416:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940721.453949:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921740416:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 75us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940721.453957:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 130 00000100:00080000:2.0:1788940721.454058:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940721.513914:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940721.514082:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921740800 00000100:00100000:1.0:1788940721.514098:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921740800 00000100:00100000:1.0:1788940721.514197:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 102 00000100:00100000:1.0:1788940721.514219:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+30:11385:x1875839921740800:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:1.0:1788940721.514551:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd84e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514575:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd84e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514593:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd84e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514635:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd855 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514642:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514649:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514752:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd85c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514762:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd85c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514768:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd85c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940721.514834:0:9713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd85c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514848:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd84e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514854:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd84e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514861:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd84e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514868:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940721.514872:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd84e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514888:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd84e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514902:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:1.0:1788940721.514905:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940721.514914:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd84e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514935:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd84e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514957:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514963:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd855 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514970:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd855 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514976:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940721.514979:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd855 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514984:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd855 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.514992:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91cf06dfef00) 00010000:00010000:1.0:1788940721.514995:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940721.514998:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd855 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.515014:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd855 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.515032:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd85c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.515039:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd85c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.515045:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd85c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.515050:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940721.515053:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd85c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.515060:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd85c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.515068:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d00293a700) 00010000:00010000:1.0:1788940721.515071:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940721.515074:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd85c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.515081:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badd85c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940721.515193:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+30:11385:x1875839921740800:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 973us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940721.516324:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 102 00000100:00100000:1.0:1788940721.598037:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940721.598181:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921741056 00000100:00100000:2.0:1788940721.598195:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921741056 00000100:00100000:2.0:1788940721.598340:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 103 00000100:00100000:2.0:1788940721.598354:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+30:11388:x1875839921741056:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1788940721.598388:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940721.598416:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd863 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7355 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.598540:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd86a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.598558:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd86a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.598574:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd86a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.598594:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd871 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.598602:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd871 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.598609:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd871 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.598765:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd878 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.598775:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd878 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.598782:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd878 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940721.598794:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788940721.598903:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd86a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.598912:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd86a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.598940:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd86a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.598948:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940721.598953:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd86a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.598963:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd86a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.598979:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:2.0:1788940721.598983:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940721.598990:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd86a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.598997:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd86a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.599013:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd871 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.599019:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd871 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.599025:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd871 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.599030:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940721.599033:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd871 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.599051:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd871 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.599059:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d00293af00) 00010000:00010000:2.0:1788940721.599062:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940721.599065:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd871 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.599071:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd871 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.599123:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd863 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7355 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.599139:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd878 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7355 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.599147:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d00293a700) 00010000:00010000:2.0:1788940721.599149:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788940721.599152:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7a00, rc 0) 00000100:00100000:2.0:1788940721.599243:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+32:11388:x1875839921741056:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 892us (1222us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788940721.599252:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 103 00000100:00100000:2.0:1788940721.603631:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940721.603715:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921741184 00000100:00100000:3.0:1788940721.603733:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921741184 00000100:00100000:3.0:1788940721.603954:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 104 00000100:00100000:3.0:1788940721.603979:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+32:11388:x1875839921741184:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:3.0:1788940721.604089:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd886 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.604112:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd81d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7339 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.604124:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd886 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.604178:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd81d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7339 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.604194:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd81d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7339 expref: 32 pid: 6521 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940721.604213:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875839944903296:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788940721.604469:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d024a26000 going to sleep for 11 seconds 00000100:00100000:3.0:1788940721.609318:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940721.609335:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875839944903296:192.168.202.25@tcp:104: 00010000:00010000:0.0:1788940721.609381:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd886 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940721.609476:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921741440 00000100:00100000:2.0:1788940721.609486:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921741440 00000100:00100000:2.0:1788940721.609554:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:2.0:1788940721.609567:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+33:6190:x1875839921741440:12345-192.168.202.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788940721.609991:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+34:6190:x1875839921741440:12345-192.168.202.25@tcp:35:ldlm_bl.0 Request processed in 426us (732us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788940721.610002:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:0.0:1788940721.614667:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940721.614798:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921741568 00000100:00100000:1.0:1788940721.614812:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921741568 00010000:00010000:1.0:1788940721.614872:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd81d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7339 expref: 34 pid: 6521 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940721.615016:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:1.0:1788940721.615029:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+34:2405:x1875839921741568:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940721.615050:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940721.615075:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd81d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7339 expref: 34 pid: 6521 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.615092:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd81d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7339 expref: 34 pid: 6521 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.615123:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd81d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7339 expref: 34 pid: 6521 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.615145:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d00293a700) 00010000:00010000:1.0:1788940721.615152:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd886 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.615165:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.615174:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd886 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.615222:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940721.615571:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+33:2405:x1875839921741568:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 543us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940721.615581:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 66 00010000:00010000:0.0:1788940721.615654:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.615665:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.615719:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.615728:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd886 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.615735:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd886 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.615753:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940721.615759:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd886 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.615768:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd886 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.615780:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d00293a700) 00010000:00010000:0.0:1788940721.615783:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940721.615788:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd886 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.615795:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badd886 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940721.615862:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+32:11388:x1875839921741184:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 11897us (12248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940721.615872:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 104 00000100:00100000:1.0:1788940721.620073:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940721.620526:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921741824 00000100:00100000:3.0:1788940721.620541:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921741824 00000100:00100000:3.0:1788940721.620615:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:3.0:1788940721.620626:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0874a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+32:11388:x1875839921741824:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:3.0:1788940721.620962:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0874a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+33:11388:x1875839921741824:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 337us (919us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788940721.620970:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:3.0:1788940721.729561:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940721.729837:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921742080 00000100:00100000:1.0:1788940721.729852:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921742080 00000100:00100000:1.0:1788940721.729955:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 105 00000100:00100000:1.0:1788940721.729968:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+33:11399:x1875839921742080:12345-192.168.202.25@tcp:101:cat.0 00010000:00010000:1.0:1788940721.730006:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940721.730036:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd88d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc735c expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730130:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd894 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730148:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd894 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730165:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd894 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730180:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd89b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730188:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd89b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730195:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd89b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730385:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd8a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730412:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730420:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940721.730433:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788940721.730541:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd894 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730549:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd894 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730556:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd894 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730563:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940721.730568:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd894 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730577:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd894 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730592:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:1.0:1788940721.730596:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940721.730604:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd894 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730612:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd894 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730628:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd89b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730640:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd89b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730646:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd89b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730651:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940721.730654:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd89b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730661:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd89b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730668:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91cf06dfef00) 00010000:00010000:1.0:1788940721.730671:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940721.730673:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd89b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730679:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd89b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730728:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badd88d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc735c expref: 36 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730742:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc735c expref: 35 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.730750:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d00293a700) 00010000:00010000:1.0:1788940721.730752:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940721.730759:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602000, rc 0) 00000100:00100000:1.0:1788940721.730843:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+35:11399:x1875839921742080:12345-192.168.202.25@tcp:101:cat.0 Request processed in 878us (1297us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788940721.730852:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 105 00000100:00100000:0.0:1788940721.740751:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940721.740839:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921742336 00000100:00100000:3.0:1788940721.740852:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921742336 00000100:00100000:3.0:1788940721.740929:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:3.0:1788940721.740941:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+35:11399:x1875839921742336:12345-192.168.202.25@tcp:35:cat.0 00000100:00100000:3.0:1788940721.741378:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+36:11399:x1875839921742336:12345-192.168.202.25@tcp:35:cat.0 Request processed in 438us (639us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788940721.741388:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:0.0:1788940721.761242:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940721.761494:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921742592 00000100:00100000:2.0:1788940721.761507:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921742592 00000100:00100000:2.0:1788940721.761591:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 106 00000100:00100000:2.0:1788940721.761604:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+36:11400:x1875839921742592:12345-192.168.202.25@tcp:36:rm.0 00010000:00010000:2.0:1788940721.761692:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788940721.761738:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd840 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7347 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.761763:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badd8a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc735c expref: 35 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.761777:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd878 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7355 expref: 34 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.761789:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badd832 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7340 expref: 33 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.761801:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d00293a700) 00010000:00010000:2.0:1788940721.761807:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940721.761834:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd8b0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.761850:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd8b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.761886:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd8b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.761901:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd8b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.761908:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd8b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.761914:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd8b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.762033:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd8be lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.762042:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd8be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.762048:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd8be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788940721.762534:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1788940721.762548:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 477095290106ns, next at 478095286282ns, rc = 0 00010000:00010000:2.0:1788940721.762606:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd8c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.762615:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd8c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.762623:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd8c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.762644:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd8c5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.762651:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd8c5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.762658:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd8c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.762960:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940721.762989:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd8be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.762996:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd8be lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.763003:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd8be lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.763009:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940721.763014:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd8be lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.763023:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd8be lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.763032:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d00293a700) 00010000:00010000:2.0:1788940721.763035:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788940721.763040:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd8be lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.763056:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd8be lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.763172:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd8b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.763185:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd8b0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.763191:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd8b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.763196:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940721.763200:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd8b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.763207:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd8b0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.763216:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:2.0:1788940721.763218:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940721.763221:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd8b0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.763419:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd8b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940721.763430:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e11ffb23 reply state 0000000035271310 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd8b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.763443:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd8b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.763458:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d00293af00) 00010000:00010000:2.0:1788940721.763460:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788940721.763463:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940721.763696:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+34:11400:x1875839921742592:12345-192.168.202.25@tcp:36:rm.0 Request processed in 2089us (2479us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788940721.763706:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 106 00010000:00010000:1.0:1788940721.771841:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940721.771860:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd8c5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.771874:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940721.771880:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd8c5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.771892:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd8c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.771925:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d00293a700) 00010000:00010000:1.0:1788940721.771928:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788940721.771935:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd8c5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.771942:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd8c5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940721.771972:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940721.771974:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940721.771976:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940721.802061:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940721.802188:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921742848 00000100:00100000:3.0:1788940721.802202:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921742848 00000100:00100000:3.0:1788940721.802322:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 107 00000100:00100000:3.0:1788940721.802333:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+34:11406:x1875839921742848:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1788940721.802365:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940721.802391:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badd8cc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7363 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.802548:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd8d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.802566:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd8d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.802600:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd8d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.802614:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd8da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.802622:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd8da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.802629:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd8da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788940721.803407:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788940721.805070:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd8e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.805095:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.805108:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.805152:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd8d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.805160:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd8d3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.805167:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd8d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.805173:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940721.805197:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd8d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.805206:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd8d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.805220:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:3.0:1788940721.805223:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940721.805230:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd8d3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.805237:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd8d3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940721.805315:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7877a4a reply state 00000000a8a707c3 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd8da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.805328:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd8da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.805334:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d00293af00) 00010000:00010000:3.0:1788940721.805337:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788940721.805340:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788940721.805385:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badd8cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7363 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.805403:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd8e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7363 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.805411:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3afd00) 00010000:00010000:3.0:1788940721.805413:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940721.805423:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937c00, rc 0) 00000100:00100000:3.0:1788940721.806015:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+37:11406:x1875839921742848:12345-192.168.202.25@tcp:101:bash.0 Request processed in 3679us (3964us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788940721.806026:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 107 00000100:00100000:3.0:1788940721.819593:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944903424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940721.819704:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940721.819906:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0874a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944903552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940721.820036:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940721.820049:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944903424 00000100:00100000:2.0:1788940721.820062:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944903424 00000100:00100000:1.0:1788940721.820137:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944903552 00000100:00100000:2.0:1788940721.820143:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788940721.820143:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944903552 00000100:00100000:2.0:1788940721.820158:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875839944903424:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940721.820176:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788940721.820195:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0874b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944903552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788940721.820201:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1788940721.820210:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940721.820296:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0874b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944903552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940721.820303:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788940721.820358:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0874a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944903552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940721.820633:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944903424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940721.820872:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940721.820949:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921742976 00000100:00100000:0.0:1788940721.820955:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921742976 00000100:00100000:0.0:1788940721.820997:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00100000:0.0:1788940721.821005:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0874a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921742976:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:0.0:1788940721.821020:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940721.821049:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010be789b/0x9c34acc08badd8ef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc736a expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940721.821102:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788940721.821126:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=477s v=(0 0) 00010000:00010000:0.0:1788940721.821132:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940721.821145:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010be789b/0x9c34acc08badd8ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc736a expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.821170:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010be789b/0x9c34acc08badd8ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc736a expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940721.821186:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d000031600, rc 0) 00000100:00100000:0.0:1788940721.821246:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0874a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+8:2405:x1875839921742976:12345-192.168.202.25@tcp:101:bash.0 Request processed in 242us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940721.821253:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00080000:3.0:1788940721.825047:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940721.825410:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940721.825858:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921743104 00000100:00100000:3.0:1788940721.825872:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921743104 00000100:00100000:3.0:1788940721.825958:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:3.0:1788940721.825972:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+8:11406:x1875839921743104:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1788940721.825998:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940721.826022:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b36189e0/0x9c34acc08badd8f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7371 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.826068:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010be789b/0x9c34acc08badd8ef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc736a expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.826080:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940721.826085:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940721.826092:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b36189e0/0x9c34acc08badd8f6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7371 expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.826141:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010be789b/0x9c34acc08badd8ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc736a expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.826157:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010be789b/0x9c34acc08badd8ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc736a expref: 9 pid: 8438 timeout: 577 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940721.826177:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875839944903424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6015us (6467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940721.826197:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788940721.826206:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8439:1875839944903680:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788940721.827215:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0011cad80 going to sleep for 11 seconds 00000001:00080000:1.0:1788940721.836202:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1788940721.836221:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:3.0:1788940721.836939:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8439:1875839944903680:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940721.836988:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b36189e0/0x9c34acc08badd8f6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7371 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.837017:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937200, rc 0) 00000100:00100000:3.0:1788940721.837099:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+7:11406:x1875839921743104:12345-192.168.202.25@tcp:101:bash.0 Request processed in 11130us (11696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940721.837110:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:0.0:1788940721.837424:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940721.839394:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921743232 00000100:00100000:2.0:1788940721.839416:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921743232 00010000:00010000:2.0:1788940721.839492:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010be789b/0x9c34acc08badd8ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc736a expref: 7 pid: 8438 timeout: 577 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940721.839554:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:2.0:1788940721.839567:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:2404:x1875839921743232:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940721.839590:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940721.839622:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010be789b/0x9c34acc08badd8ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc736a expref: 7 pid: 8438 timeout: 577 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.839839:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010be789b/0x9c34acc08badd8ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc736a expref: 7 pid: 8438 timeout: 577 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.839895:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010be789b/0x9c34acc08badd8ef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc736a expref: 7 pid: 8438 timeout: 577 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.839938:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940721.839944:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940721.839955:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b36189e0/0x9c34acc08badd8f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7371 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.839967:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b36189e0/0x9c34acc08badd8f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7371 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940721.840026:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b36189e0/0x9c34acc08badd8f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7371 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940721.840044:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1875839944903808:192.168.202.25@tcp:105: 00000100:00100000:2.0:1788940721.840170:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050eab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940721.845318:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6506:1875839944903808:192.168.202.25@tcp:105: 00010000:00010000:2.0:1788940721.845357:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940721.845448:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921743232:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 5883us (8024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940721.845460:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:0.0:1788940721.849038:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940721.849101:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921743488 00000100:00100000:3.0:1788940721.849115:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921743488 00000100:00100000:3.0:1788940721.849188:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:3.0:1788940721.849200:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+37:11406:x1875839921743488:12345-192.168.202.25@tcp:35:bash.0 00000100:00100000:0.0:1788940721.849794:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+38:11406:x1875839921743488:12345-192.168.202.25@tcp:35:bash.0 Request processed in 592us (765us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788940721.849805:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:1.0:1788940721.996878:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940721.997026:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921743616 00000100:00100000:3.0:1788940721.997041:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921743616 00000100:00100000:3.0:1788940721.997120:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 108 00000100:00100000:3.0:1788940721.997135:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+38:11422:x1875839921743616:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940721.997171:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940721.997201:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd8fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7378 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.997319:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08badd904 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.997361:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08badd904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.997376:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08badd904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940721.997436:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788940721.997440:0:8517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940721.997463:0:8517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08badd904 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.997779:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badd8fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7378 expref: 40 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.997803:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08badd904 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7378 expref: 39 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940721.997813:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:3.0:1788940721.997816:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940721.997821:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936400, rc 0) 00000100:00100000:3.0:1788940721.997899:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+39:11422:x1875839921743616:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 767us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940721.997907:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 108 00000100:00100000:3.0:1788940722.002495:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940722.002661:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921743872 00000100:00100000:2.0:1788940722.002676:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921743872 00000100:00100000:2.0:1788940722.002755:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 109 00000100:00100000:2.0:1788940722.002787:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+39:11422:x1875839921743872:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1788940722.002819:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940722.002849:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd90b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc737f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.003019:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd912 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.003038:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd912 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.003053:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd912 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940722.003068:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788940722.003206:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd90b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc737f expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.003229:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd912 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc737f expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.003238:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3afd00) 00010000:00010000:2.0:1788940722.003242:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940722.003246:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6a00, rc 0) 00000100:00100000:2.0:1788940722.003376:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+41:11422:x1875839921743872:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 592us (906us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1788940722.003384:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 109 00000100:00100000:0.0:1788940722.008355:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940722.008711:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921744000 00000100:00100000:2.0:1788940722.008725:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921744000 00000100:00100000:2.0:1788940722.008833:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:2.0:1788940722.008846:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+41:2407:x1875839921744000:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940722.008864:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940722.008897:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd912 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc737f expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.008932:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3afd00) 00010000:00010000:2.0:1788940722.008939:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940722.009021:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+40:2407:x1875839921744000:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 177us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940722.009029:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:0.0:1788940722.009298:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940722.009604:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921744256 00000100:00100000:1.0:1788940722.009611:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921744256 00000100:00100000:1.0:1788940722.009666:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 110 00000100:00100000:1.0:1788940722.009675:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+40:11422:x1875839921744256:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788940722.009703:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940722.009724:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd920 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7386 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.009863:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd927 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.009882:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.009897:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940722.009944:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788940722.010096:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badd920 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7386 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.010117:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd927 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7386 expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.010126:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3afd00) 00010000:00010000:1.0:1788940722.010129:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788940722.010132:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603c00, rc 0) 00000100:00100000:1.0:1788940722.010176:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+42:11422:x1875839921744256:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 502us (879us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1788940722.010184:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 110 00000100:00100000:0.0:1788940722.017466:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940722.017657:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921744384 00000100:00100000:1.0:1788940722.017671:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921744384 00000100:00100000:1.0:1788940722.017749:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:1.0:1788940722.017762:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+6:2405:x1875839921744384:12345-192.168.202.25@tcp:1:lfs.0 00010000:00010000:1.0:1788940722.017825:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badd935 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.017852:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b36189e0/0x9c34acc08badd8f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7371 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.017862:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940722.017866:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788940722.017871:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badd935 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.017951:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b36189e0/0x9c34acc08badd8f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7371 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.017968:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b36189e0/0x9c34acc08badd8f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7371 expref: 6 pid: 8439 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940722.017986:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08749c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8438:1875839944903936:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940722.018107:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd900 going to sleep for 11 seconds 00000100:00100000:3.0:1788940722.020930:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940722.021124:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08749c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8438:1875839944903936:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940722.021165:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badd935 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940722.021304:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921744512 00000100:00100000:2.0:1788940722.021314:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921744512 00002000:00100000:2.0:1788940722.021381:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff91d03475aa00 x1875839921744512/t0(0) o4->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:698/0 lens 504/0 e 0 to 0 dl 1788940733 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788940722.021391:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91d03475aa00 with x1875839921744512 ext(0->8) 00010000:00010000:2.0:1788940722.021400:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b36189e0/0x9c34acc08badd8f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7371 expref: 7 pid: 8439 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.021416:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b36189e0/0x9c34acc08badd8f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7371 expref: 7 pid: 8439 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788940722.021424:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91d03475aa00 00000100:00100000:2.0:1788940722.021466:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:2.0:1788940722.021601:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82f3b232-46da-4a78-8599-45df2ddbced0+7:2404:x1875839921744512:12345-192.168.202.25@tcp:4:lfs.0 00000100:00100000:2.0:1788940722.023072:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82f3b232-46da-4a78-8599-45df2ddbced0+9:2404:x1875839921744512:12345-192.168.202.25@tcp:4:lfs.0 Request processed in 1587us (2163us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788940722.023100:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 1 00002000:00100000:2.0:1788940722.023114:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff91d03475aa00 x1875839921744512/t4294967303(0) o4->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:698/0 lens 504/448 e 0 to 0 dl 1788940733 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788940722.023126:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91d03475aa00 with x1875839921744512 ext(0->8) 00010000:00010000:2.0:1788940722.023138:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b36189e0/0x9c34acc08badd8f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7371 expref: 9 pid: 8439 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.023159:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b36189e0/0x9c34acc08badd8f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7371 expref: 9 pid: 8439 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788940722.023168:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91d03475aa00 00000100:00100000:2.0:1788940722.026836:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940722.026950:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921744640 00000100:00100000:3.0:1788940722.027041:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921744640 00010000:00010000:3.0:1788940722.027097:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b36189e0/0x9c34acc08badd8f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7371 expref: 9 pid: 8439 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940722.027208:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 68 00000100:00100000:3.0:1788940722.027222:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050db050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+9:2405:x1875839921744640:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940722.027243:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788940722.027302:0:7474:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788940722.027306:0:7474:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788940722 00002000:00010000:3.0:1788940722.027309:0:7474:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788940722 00002000:00010000:3.0:1788940722.027311:0:7474:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788940722 00002000:00010000:3.0:1788940722.027313:0:7474:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788940722.027321:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b36189e0/0x9c34acc08badd8f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7371 expref: 9 pid: 8439 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940722.027338:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b36189e0/0x9c34acc08badd8f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7371 expref: 9 pid: 8439 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940722.027369:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b36189e0/0x9c34acc08badd8f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7371 expref: 9 pid: 8439 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940722.027390:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940722.027396:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940722.027403:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badd935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940722.027414:0:7474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badd935 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940722.027471:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940722.027552:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050db050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+8:2405:x1875839921744640:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 332us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940722.027561:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 68 00010000:00010000:1.0:1788940722.027980:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badd935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.027993:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badd935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.028019:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badd935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.028028:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badd935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.028054:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badd935 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.028063:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940722.028068:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badd935 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.028079:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badd935 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.028095:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badd935 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.028105:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badd935 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940722.028182:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921744384:12345-192.168.202.25@tcp:1:lfs.0 Request processed in 10422us (10731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940722.028191:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:2.0:1788940722.031754:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940722.031888:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921744896 00000100:00100000:0.0:1788940722.031902:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921744896 00000100:00100000:0.0:1788940722.032095:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:0.0:1788940722.032130:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d002e67c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+42:11422:x1875839921744896:12345-192.168.202.25@tcp:35:lfs.0 00000004:00010000:0.0:1788940722.032219:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd927 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7386 expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940722.032523:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1788940722.032556:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788940722.033000:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1788940722.033051:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd93c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940722.033071:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd8e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7363 expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940722.033083:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd93c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940722.033131:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd8e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7363 expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940722.033151:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd8e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7363 expref: 46 pid: 6520 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940722.033167:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c9aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1875839944904064:192.168.202.25@tcp:104: 00000100:00100000:0.0:1788940722.033316:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06f4ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940722.036960:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940722.037050:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921745024 00000100:00100000:1.0:1788940722.037063:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921745024 00010000:00010000:1.0:1788940722.037117:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd8e1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7363 expref: 47 pid: 6520 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940722.037166:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 69 00000100:00100000:1.0:1788940722.037194:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+47:2404:x1875839921745024:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940722.037213:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940722.037221:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd8e1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7363 expref: 47 pid: 6520 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.037237:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd8e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7363 expref: 47 pid: 6520 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.037301:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3afd00) 00010000:00010000:1.0:1788940722.037308:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd93c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.037319:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd93c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.037327:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd93c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.037352:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940722.037464:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+47:2404:x1875839921745024:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 271us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940722.037471:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 69 00010000:00010000:2.0:1788940722.037879:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badd8e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7363 expref: 46 pid: 6520 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940722.037899:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c9aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1875839944904064:192.168.202.25@tcp:104: 00010000:00010000:2.0:1788940722.037942:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd93c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.037952:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd93c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.037958:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd93c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940722.038137:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1788940722.038395:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788940722.038625:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875839944904192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788940722.038777:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940722.038822:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788940722.038990:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944904192 00000100:00100000:1.0:1788940722.038998:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944904192 00000100:00100000:1.0:1788940722.039077:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788940722.039088:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1875839944904192:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788940722.039191:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1875839944904192:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 105us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940722.039213:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:3.0:1788940722.039309:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940722.039429:0:6524:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:2.0:1788940722.039436:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:2.0:1788940722.039488:0:6524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d037873100, transno 4294967302 00000100:00100000:2.0:1788940722.039503:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875839944904192:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788940722.039794:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1788940722.039869:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf084dca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875839944904320:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788940722.039910:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940722.040365:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788940722.042078:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944904320 00000100:00100000:3.0:1788940722.042097:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944904320 00000100:00100000:2.0:1788940722.042334:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788940722.042348:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1875839944904320:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788940722.042642:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6524:x1875839944904320:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 289us (2722us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788940722.042651:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788940722.042752:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf084dca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875839944904320:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788940722.042841:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1788940722.042896:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd93c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940722.042908:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd93c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940722.042929:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd93c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940722.042936:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940722.042941:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd93c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940722.042951:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd93c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940722.042971:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3afd00) 00010000:00010000:3.0:1788940722.042974:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788940722.042981:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd93c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940722.043010:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badd93c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788940722.043153:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788940722.043234:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1788940722.043249:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 477375990812ns, next at 478375988032ns, rc = 0 00000001:00080000:3.0:1788940722.043284:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1788940722.043312:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3afd00) 00010000:00010000:3.0:1788940722.043315:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788940722.043325:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badd927 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7386 expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940722.043472:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d002e67c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+49:11422:x1875839921744896:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 11344us (11732us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788940722.043483:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 26 00000020:00080000:3.0:1788940722.043488:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788940722.046382:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940722.046495:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921745152 00000100:00100000:3.0:1788940722.046509:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921745152 00000100:00100000:3.0:1788940722.046589:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 111 00000100:00100000:3.0:1788940722.046602:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+49:11422:x1875839921745152:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940722.046633:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940722.046676:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badd943 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc738d expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940722.046752:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badd943 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc738d expref: 50 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940722.046796:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badd943 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc738d expref: 50 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940722.046820:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:3.0:1788940722.046823:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940722.046827:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937200, rc 0) 00000100:00100000:3.0:1788940722.046900:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+50:11422:x1875839921745152:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 301us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940722.046908:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 111 00000100:00100000:0.0:1788940722.050075:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940722.050206:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921745408 00000100:00100000:1.0:1788940722.050222:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921745408 00000100:00100000:1.0:1788940722.050320:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:1.0:1788940722.050333:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+50:11422:x1875839921745408:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:1.0:1788940722.050666:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+51:11422:x1875839921745408:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 336us (603us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788940722.050675:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:0.0:1788940722.139792:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940722.139950:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921745536 00000100:00100000:1.0:1788940722.139965:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921745536 00000100:00100000:1.0:1788940722.140052:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 112 00000100:00100000:1.0:1788940722.140066:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+51:11432:x1875839921745536:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:1.0:1788940722.140177:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd94a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140212:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd94a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140228:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd94a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140242:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd951 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140251:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd951 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140284:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd951 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140396:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd958 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140405:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140412:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940722.140604:0:9713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140623:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd94a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140630:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd94a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140650:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd94a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140657:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940722.140662:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd94a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140671:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd94a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140685:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:1.0:1788940722.140689:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940722.140696:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd94a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140711:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd94a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140727:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd951 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140734:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd951 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140740:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd951 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140746:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940722.140749:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd951 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140755:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd951 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140764:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d00293af00) 00010000:00010000:1.0:1788940722.140766:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940722.140770:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd951 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140776:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd951 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140787:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140793:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd958 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140807:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd958 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140812:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940722.140815:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd958 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140820:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd958 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140828:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:1.0:1788940722.140831:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940722.140834:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd958 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.140840:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badd958 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940722.140940:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+51:11432:x1875839921745536:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 876us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940722.140949:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 112 00000100:00100000:0.0:1788940722.179985:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940722.180191:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921745792 00000100:00100000:2.0:1788940722.180205:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921745792 00000100:00100000:2.0:1788940722.180301:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 113 00000100:00100000:2.0:1788940722.180314:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+51:11435:x1875839921745792:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1788940722.180344:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940722.180371:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd95f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7394 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.180485:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd966 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.180517:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd966 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.180534:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd966 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.180548:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd96d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.180557:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd96d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.180564:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd96d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.180731:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd974 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.180740:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.180748:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940722.180761:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788940722.180897:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd966 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.180907:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd966 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.180927:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd966 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.180941:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940722.180947:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd966 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.180957:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd966 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.181209:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:2.0:1788940722.181213:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940722.181220:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd966 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.181227:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd966 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.181245:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd96d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.181251:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd96d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.181315:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd96d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.181322:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940722.181324:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd96d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.181331:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd96d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.181354:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d00293af00) 00010000:00010000:2.0:1788940722.181357:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940722.181361:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd96d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.181368:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd96d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.181417:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd95f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7394 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.181432:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd974 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7394 expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.181440:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:2.0:1788940722.181442:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940722.181445:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7000, rc 0) 00000100:00100000:2.0:1788940722.182130:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+53:11435:x1875839921745792:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 1812us (2168us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788940722.182140:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 113 00000100:00100000:0.0:1788940722.186340:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940722.186504:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921745920 00000100:00100000:2.0:1788940722.186518:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921745920 00000100:00100000:2.0:1788940722.186601:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 114 00000100:00100000:2.0:1788940722.186613:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+53:11435:x1875839921745920:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:2.0:1788940722.186727:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd982 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.186750:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd982 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.186785:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd982 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.186834:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd982 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.186842:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd982 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.186850:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd982 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.186856:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940722.186861:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd982 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.186870:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd982 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.186883:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:2.0:1788940722.186887:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940722.186894:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd982 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.186900:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd982 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940722.187336:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+53:11435:x1875839921745920:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 723us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940722.187346:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 114 00000100:00100000:1.0:1788940722.192684:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940722.192773:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921746176 00000100:00100000:3.0:1788940722.192786:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921746176 00000100:00100000:3.0:1788940722.192852:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:3.0:1788940722.192863:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+53:11435:x1875839921746176:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:3.0:1788940722.193365:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+54:11435:x1875839921746176:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 501us (692us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1788940722.193375:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:0.0:1788940722.264529:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940722.264780:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921746432 00000100:00100000:1.0:1788940722.264796:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921746432 00000100:00100000:1.0:1788940722.264880:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 115 00000100:00100000:1.0:1788940722.264894:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+54:11445:x1875839921746432:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:1.0:1788940722.264943:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940722.264947:0:9713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788940722.264984:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08badd904 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7378 expref: 54 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.265028:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:1.0:1788940722.265035:0:9713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940722.265054:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd989 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc739b expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.265192:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd990 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.265210:0:9713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd974 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7394 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.265218:0:9713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd990 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.265329:0:9713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd974 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7394 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.265346:0:9713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd974 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7394 expref: 54 pid: 6522 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940722.265362:0:9713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08749180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9713:1875839944904448:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940722.265655:0:9713:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940722.269191:0:9713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08749180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9713:1875839944904448:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940722.269237:0:9713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd990 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940722.270903:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940722.271695:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921746560 00000100:00100000:2.0:1788940722.271730:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921746560 00010000:00010000:2.0:1788940722.271788:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd974 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7394 expref: 55 pid: 6522 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940722.271905:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 70 00000100:00100000:2.0:1788940722.271932:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+55:2405:x1875839921746560:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940722.271953:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940722.271961:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd974 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7394 expref: 55 pid: 6522 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.271993:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd974 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7394 expref: 55 pid: 6522 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.272020:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd974 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7394 expref: 55 pid: 6522 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.272041:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:2.0:1788940722.272048:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd990 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.272059:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd990 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.272069:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd990 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.272159:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940722.272241:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+54:2405:x1875839921746560:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 312us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940722.272302:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 70 00010000:00010000:1.0:1788940722.273832:0:9713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd990 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.273868:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd990 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940722.273897:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788940722.274214:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd989 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc739b expref: 55 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.274242:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd990 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc739b expref: 54 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.274251:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:1.0:1788940722.274274:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788940722.274278:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602c00, rc 0) 00000100:00100000:1.0:1788940722.274426:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+54:11445:x1875839921746432:12345-192.168.202.25@tcp:101:bash.0 Request processed in 9535us (9914us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788940722.274436:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 115 00000100:00100000:0.0:1788940722.280212:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940722.280896:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921746688 00000100:00100000:2.0:1788940722.280923:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921746688 00000100:00100000:2.0:1788940722.281292:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 116 00000100:00100000:2.0:1788940722.281310:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+54:11445:x1875839921746688:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1788940722.281347:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940722.281375:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd99e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc73a2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.281424:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd9a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.281444:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.281458:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.281624:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd99e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73a2 expref: 56 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.281659:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd9a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73a2 expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.281669:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:2.0:1788940722.281673:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788940722.281677:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7600, rc 0) 00000100:00100000:2.0:1788940722.281750:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+55:11445:x1875839921746688:12345-192.168.202.25@tcp:101:bash.0 Request processed in 447us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940722.281766:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 116 00000100:00100000:0.0:1788940722.284725:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940722.284976:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921746944 00000100:00100000:2.0:1788940722.284991:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921746944 00000100:00100000:2.0:1788940722.285077:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 117 00000100:00100000:2.0:1788940722.285090:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+55:11445:x1875839921746944:12345-192.168.202.25@tcp:36:bash.0 00010000:00010000:2.0:1788940722.285453:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd9ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.285475:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd9ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.285489:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd9ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940722.285541:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788940722.285573:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c741e829 reply state 0000000054e2289e transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd9ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.285588:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd9ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.285598:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:2.0:1788940722.285601:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788940722.285607:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940722.285719:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+58:11445:x1875839921746944:12345-192.168.202.25@tcp:36:bash.0 Request processed in 631us (1009us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788940722.285727:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 117 00000020:00080000:2.0:1788940722.285733:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788940722.288711:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940722.288825:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921747072 00000100:00100000:1.0:1788940722.288841:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921747072 00000100:00100000:1.0:1788940722.288926:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 118 00000100:00100000:1.0:1788940722.288938:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+58:11445:x1875839921747072:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:1.0:1788940722.288981:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940722.289010:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd9b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc73a9 expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.289148:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd9ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.289187:0:9713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd990 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc739b expref: 59 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.289198:0:9713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd9ba lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.289305:0:9713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd990 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc739b expref: 59 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.289322:0:9713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd990 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc739b expref: 59 pid: 9713 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940722.289339:0:9713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08749180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9713:1875839944904576:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940722.289448:0:9713:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940722.293865:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940722.293942:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921747200 00000100:00100000:2.0:1788940722.293980:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921747200 00010000:00010000:2.0:1788940722.294037:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd990 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc739b expref: 60 pid: 9713 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940722.294102:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 71 00000100:00100000:2.0:1788940722.294115:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+60:2404:x1875839921747200:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940722.294135:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940722.294142:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd990 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc739b expref: 60 pid: 9713 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.294155:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd990 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc739b expref: 60 pid: 9713 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.294178:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:2.0:1788940722.294183:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd9ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.294192:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd9ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.294199:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd9ba lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.294217:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940722.294499:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+60:2404:x1875839921747200:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 386us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940722.294505:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 71 00010000:00010000:1.0:1788940722.295009:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd990 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc739b expref: 59 pid: 9713 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940722.295033:0:9713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08749180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9713:1875839944904576:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940722.295993:0:9713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd9ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.296012:0:9713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd9ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.296018:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd9ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940722.296111:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788940722.296136:0:9713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788940722.296172:0:9713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd9ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.296219:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd9b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73a9 expref: 59 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.296244:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd9ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73a9 expref: 58 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.296253:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:1.0:1788940722.296283:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940722.296287:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603800, rc 0) 00000100:00100000:1.0:1788940722.296366:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+58:11445:x1875839921747072:12345-192.168.202.25@tcp:101:bash.0 Request processed in 7429us (7668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940722.296376:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 118 00000100:00100000:0.0:1788940722.301062:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940722.303765:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921747456 00000100:00100000:3.0:1788940722.303788:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921747456 00000100:00100000:2.0:1788940722.304111:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:2.0:1788940722.304127:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+58:11445:x1875839921747456:12345-192.168.202.25@tcp:35:bash.0 00000100:00100000:2.0:1788940722.304799:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+59:11445:x1875839921747456:12345-192.168.202.25@tcp:35:bash.0 Request processed in 671us (3749us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1788940722.304812:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:0.0:1788940722.361484:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940722.361606:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921747584 00000100:00100000:2.0:1788940722.361621:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921747584 00000100:00100000:2.0:1788940722.361718:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 119 00000100:00100000:2.0:1788940722.361730:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+59:11451:x1875839921747584:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1788940722.361765:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940722.361794:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd9c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc73b0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.361882:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd9c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.361900:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.361928:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940722.362010:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788940722.362015:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788940722.362043:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.362076:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd9c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73b0 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.362100:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73b0 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.362134:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:2.0:1788940722.362138:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940722.362142:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6800, rc 0) 00000100:00100000:2.0:1788940722.362227:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+60:11451:x1875839921747584:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 498us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940722.362235:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 119 00000100:00100000:0.0:1788940722.369368:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940722.369485:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921747712 00000100:00100000:2.0:1788940722.369499:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921747712 00000100:00100000:2.0:1788940722.369580:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 120 00000100:00100000:2.0:1788940722.369590:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+60:11451:x1875839921747712:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1788940722.369616:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940722.369640:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd9cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc73b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.369714:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd9d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.369729:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd9d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.369739:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd9d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.369748:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd9dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.369754:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd9dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.369777:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd9dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.369861:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd9e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.369867:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd9e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.369871:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd9e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940722.369931:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788940722.369937:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788940722.369966:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd9e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.369981:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd9e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.369990:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd9d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.369997:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd9d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.370004:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd9d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.370011:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940722.370016:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd9d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.370032:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd9d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.370047:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:2.0:1788940722.370050:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940722.370057:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd9d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.370064:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08badd9d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.370079:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd9dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.370084:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd9dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.370090:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd9dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.370096:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940722.370099:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd9dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.370105:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd9dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.370113:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d00293af00) 00010000:00010000:2.0:1788940722.370115:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940722.370118:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd9dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.370135:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badd9dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.370172:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08badd9cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73b7 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.370186:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd9e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73b7 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.370194:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:2.0:1788940722.370196:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940722.370200:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6c00, rc 0) 00000100:00100000:2.0:1788940722.370657:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+61:11451:x1875839921747712:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 1062us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940722.370666:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 120 00000100:00100000:0.0:1788940722.374927:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940722.375067:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940722.375210:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921748096 00000100:00100000:3.0:1788940722.375223:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921748096 00000100:00100000:3.0:1788940722.375339:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:3.0:1788940722.375352:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+61:2404:x1875839921748096:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940722.375372:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940722.375404:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08badd9e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73b7 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940722.375444:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:3.0:1788940722.375450:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940722.375511:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+60:2404:x1875839921748096:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 161us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940722.375519:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:1.0:1788940722.375599:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921747968 00000100:00100000:1.0:1788940722.375605:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921747968 00000100:00100000:1.0:1788940722.375651:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 121 00000100:00100000:1.0:1788940722.375660:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+60:11451:x1875839921747968:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788940722.375682:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940722.375703:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd9eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc73be expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.375847:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd9f2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.375864:0:9713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd9ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73a9 expref: 61 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.375885:0:9713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd9f2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.375939:0:9713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd9ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73a9 expref: 61 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940722.375956:0:9713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd9ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73a9 expref: 61 pid: 9713 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940722.376028:0:9713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08749180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9713:1875839944904704:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940722.376117:0:9713:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940722.379208:0:9713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08749180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9713:1875839944904704:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940722.379253:0:9713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd9f2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940722.380620:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940722.381523:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921748224 00000100:00100000:2.0:1788940722.381540:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921748224 00010000:00010000:2.0:1788940722.381600:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd9ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73a9 expref: 62 pid: 9713 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940722.381663:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 72 00000100:00100000:2.0:1788940722.381675:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+62:2405:x1875839921748224:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940722.381695:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940722.381703:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd9ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73a9 expref: 62 pid: 9713 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.381746:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd9ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73a9 expref: 62 pid: 9713 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.381777:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badd9ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73a9 expref: 62 pid: 9713 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.381798:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:2.0:1788940722.381804:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd9f2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.381817:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd9f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.381826:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd9f2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.381870:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940722.382305:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+61:2405:x1875839921748224:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 294us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940722.382315:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 72 00010000:00010000:0.0:1788940722.382571:0:9713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd9f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940722.382581:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd9f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940722.382609:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788940722.382812:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badd9eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73be expref: 62 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940722.382837:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd9f2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73be expref: 61 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940722.382846:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:0.0:1788940722.382849:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788940722.382867:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603200, rc 0) 00000100:00100000:0.0:1788940722.382942:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+61:11451:x1875839921747968:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 7282us (8043us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788940722.382951:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 121 00000100:00100000:0.0:1788940722.386461:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940722.386596:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921748480 00000100:00100000:3.0:1788940722.386611:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921748480 00000100:00100000:3.0:1788940722.386706:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:3.0:1788940722.386720:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+61:11451:x1875839921748480:12345-192.168.202.25@tcp:103:lfs.0 00010000:00010000:3.0:1788940722.386741:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940722.386772:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badd943 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc738d expref: 61 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940722.386795:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:3.0:1788940722.386802:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940722.386875:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+60:11451:x1875839921748480:12345-192.168.202.25@tcp:103:lfs.0 Request processed in 157us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940722.386883:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:2.0:1788940722.389394:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940722.389575:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921748608 00000100:00100000:3.0:1788940722.389591:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921748608 00000100:00100000:3.0:1788940722.389675:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 122 00000100:00100000:3.0:1788940722.389687:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+60:11451:x1875839921748608:12345-192.168.202.25@tcp:58:lfs.0 00010000:00010000:3.0:1788940722.389838:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badda00 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940722.389879:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badda00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940722.389894:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badda00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788940722.390042:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788940722.390151:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+60:11451:x1875839921748608:12345-192.168.202.25@tcp:58:lfs.0 Request processed in 466us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940722.390159:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 122 00000100:00100000:0.0:1788940722.393420:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940722.393590:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921748736 00000100:00100000:2.0:1788940722.393606:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921748736 00000100:00100000:2.0:1788940722.393794:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 123 00000100:00100000:2.0:1788940722.393809:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+60:11451:x1875839921748736:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1788940722.393839:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940722.393869:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badda07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc73c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.393989:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badda00 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.394003:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badda07 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73c5 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.394030:0:6521:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badda00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.394047:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badda07 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73c5 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.394065:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:2.0:1788940722.394068:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940722.394073:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badda07 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73c5 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940722.394082:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7400, rc 0) 00000100:00100000:2.0:1788940722.394172:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+61:11451:x1875839921748736:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 367us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940722.394180:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 123 00010000:00010000:3.0:1788940722.463136:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940722.843836:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940722.843869:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944904832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940722.844003:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940722.844430:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944904832 00000100:00100000:2.0:1788940722.844442:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944904832 00000100:00100000:2.0:1788940722.844510:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788940722.844522:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944904832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940722.844568:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940722.844648:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944904832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940722.844673:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788940722.844863:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944904832:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788940723.227559:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940723.227572:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940723.227607:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788940723.227618:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788940723.227813:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086ff480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1875839944904960:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788940723.227986:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06f4ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940723.236761:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940723.236930:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921748864 00000100:00100000:1.0:1788940723.236944:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921748864 00000100:00100000:1.0:1788940723.237038:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 124 00000100:00100000:1.0:1788940723.237051:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+62:11452:x1875839921748864:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788940723.237098:0:9713:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788940723.237302:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+62:11452:x1875839921748864:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 210us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940723.237333:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 124 00000100:00080000:3.0:1788940723.238601:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940723.242331:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940723.242884:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921748992 00000100:00100000:3.0:1788940723.242898:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921748992 00000100:00100000:3.0:1788940723.242990:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 125 00000100:00100000:3.0:1788940723.243003:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+62:11452:x1875839921748992:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788940723.243108:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badda0e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.243131:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badda0e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.243149:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badda0e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.243166:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badda15 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.243199:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badda15 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.243205:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badda15 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940723.243834:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086ff480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1875839944904960:192.168.202.25@tcp:107:hsm_cdtr.0 00010000:00010000:3.0:1788940723.244591:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badda1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244612:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badda1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244635:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badda1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940723.244698:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788940723.244704:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940723.244723:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badda1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244736:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badda0e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244743:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badda0e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244751:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badda0e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244757:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940723.244762:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badda0e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244787:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badda0e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244803:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91cf07e67400) 00010000:00010000:3.0:1788940723.244807:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940723.244813:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badda0e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244820:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08badda0e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244837:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badda15 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244842:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badda15 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244848:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badda15 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244854:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940723.244857:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badda15 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244863:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badda15 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244869:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff91d00c3afc00) 00010000:00010000:3.0:1788940723.244871:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940723.244874:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badda15 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244889:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badda15 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244918:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badda1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244924:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badda1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244929:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badda1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244935:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940723.244938:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badda1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244944:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badda1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244952:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:3.0:1788940723.244954:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940723.244957:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badda1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.244963:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badda1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.245082:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+61:11452:x1875839921748992:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 Request processed in 2078us (2763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.245094:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 125 00000100:00100000:1.0:1788940723.252855:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940723.253080:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921749248 00000100:00100000:2.0:1788940723.253094:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921749248 00000100:00100000:2.0:1788940723.253185:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 126 00000100:00100000:2.0:1788940723.253199:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+61:11452:x1875839921749248:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940723.253230:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940723.253302:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badda23 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc73cc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.253498:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badda2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.253519:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badda2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.253535:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badda2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940723.253549:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788940723.253830:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badda2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.253840:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badda2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.253849:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badda2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.253857:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940723.253873:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badda2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.253883:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badda2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.253898:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:2.0:1788940723.253913:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788940723.253921:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badda2a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.253929:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badda2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.254428:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badda23 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73cc expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.254443:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91cf07e67400) 00010000:00010000:2.0:1788940723.254446:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940723.254450:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badda23 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73cc expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.254476:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7c00, rc 0) 00000100:00100000:2.0:1788940723.254620:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+62:11452:x1875839921749248:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1422us (1779us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1788940723.254640:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 126 00000100:00100000:1.0:1788940723.278014:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940723.278141:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921749376 00000100:00100000:0.0:1788940723.278155:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921749376 00000100:00100000:0.0:1788940723.278251:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 127 00000100:00100000:0.0:1788940723.278296:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0874b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+62:11452:x1875839921749376:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788940723.278355:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788940723.278531:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0874b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+62:11452:x1875839921749376:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 240us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940723.278539:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 127 00000100:00100000:0.0:1788940723.292209:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940723.293316:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921749632 00000100:00100000:3.0:1788940723.293334:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921749632 00000100:00100000:3.0:1788940723.293417:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 128 00000100:00100000:3.0:1788940723.293430:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+62:11452:x1875839921749632:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940723.293459:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940723.293478:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788940723.293519:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badd9c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73b0 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.293547:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:3.0:1788940723.293553:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940723.293570:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badda38 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc73d3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788940723.294105:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788940723.294330:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badda3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.294348:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badda3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.294361:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badda3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.294422:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badda38 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73d3 expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.294441:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badda3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73d3 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.294474:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91d00c3afc00) 00010000:00010000:3.0:1788940723.294477:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940723.294481:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936a00, rc 0) 00000100:00100000:3.0:1788940723.294562:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+63:11452:x1875839921749632:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1134us (2368us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788940723.294570:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 128 00000100:00100000:3.0:1788940723.301285:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940723.301503:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921749888 00000100:00100000:0.0:1788940723.301518:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921749888 00000100:00100000:0.0:1788940723.301601:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 129 00000100:00100000:0.0:1788940723.301615:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+63:11452:x1875839921749888:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788940723.301734:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940723.301770:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badda3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73d3 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.301795:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91d00c3afc00) 00010000:00010000:0.0:1788940723.301809:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940723.301839:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badda4d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.301856:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badda4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.301868:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badda4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.301886:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badda54 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xa37a50c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.301894:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badda54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa37a50c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.301914:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badda54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa37a50c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.301989:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badda4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.301998:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badda4d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.302006:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badda4d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.302020:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940723.302025:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badda4d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.302034:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badda4d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.302044:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:0.0:1788940723.302046:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940723.302051:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badda4d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.302057:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badda4d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.302069:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badda54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa37a50c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.302076:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badda54 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa37a50c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.302082:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badda54 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa37a50c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.302087:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940723.302089:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badda54 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa37a50c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.302096:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badda54 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa37a50c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.302118:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xa37a50c3 (ffff91d0421d1600) 00010000:00010000:0.0:1788940723.302120:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940723.302123:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badda54 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa37a50c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.302130:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08badda54 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa37a50c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940723.302233:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+62:11452:x1875839921749888:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 621us (978us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940723.302241:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 129 00000100:00100000:1.0:1788940723.308096:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940723.315513:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921750016 00000100:00100000:0.0:1788940723.315536:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921750016 00000100:00100000:0.0:1788940723.315643:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 130 00000100:00100000:0.0:1788940723.315657:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0874ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+62:11452:x1875839921750016:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940723.315685:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940723.315718:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08badda5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc73da expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.315766:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badda62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.315783:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badda62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.315798:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badda62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.318369:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08badda5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73da expref: 64 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.318447:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badda62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73da expref: 63 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.318459:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:0.0:1788940723.318463:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788940723.318468:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d000031600, rc 0) 00000100:00100000:0.0:1788940723.318576:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0874ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+63:11452:x1875839921750016:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 2920us (10495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940723.318587:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 130 00000100:00100000:1.0:1788940723.322591:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940723.323297:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921750272 00000100:00100000:0.0:1788940723.323314:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921750272 00000100:00100000:0.0:1788940723.323397:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 131 00000100:00100000:0.0:1788940723.323409:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+63:11452:x1875839921750272:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788940723.323526:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badda69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.323549:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badda69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.323565:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badda69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788940723.323781:0:9713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1788940723.323794:0:9713:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 478656536402ns, next at 479656531716ns, rc = 0 00000004:00010000:0.0:1788940723.323867:0:9713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a0c786e reply state 000000000db21a5d transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badda69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.323918:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badda69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.323928:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:0.0:1788940723.323931:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788940723.323936:0:9713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940723.324121:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+65:11452:x1875839921750272:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 710us (1543us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788940723.324132:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 131 00000100:00100000:3.0:1788940723.329928:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940723.330086:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921750400 00000100:00100000:0.0:1788940723.330102:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921750400 00000100:00100000:0.0:1788940723.330188:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 132 00000100:00100000:0.0:1788940723.330200:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+65:11452:x1875839921750400:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940723.330246:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940723.330318:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08badda70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc73e1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.330403:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08badda70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73e1 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.330421:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08badda70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73e1 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.330574:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:1.0:1788940723.330579:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940723.330584:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d000031c00, rc 0) 00000100:00100000:1.0:1788940723.330674:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+66:11452:x1875839921750400:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 476us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940723.330683:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 132 00000100:00100000:3.0:1788940723.338527:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940723.338780:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921750528 00000100:00100000:0.0:1788940723.338795:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921750528 00000100:00100000:0.0:1788940723.338917:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00100000:0.0:1788940723.338930:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+8:2407:x1875839921750528:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788940723.339318:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+9:2407:x1875839921750528:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 390us (809us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788940723.339326:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00080000:3.0:1788940723.341521:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940723.349788:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940723.354370:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921750784 00000100:00100000:3.0:1788940723.354395:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921750784 00000100:00100000:3.0:1788940723.354510:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:3.0:1788940723.354525:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+66:11452:x1875839921750784:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788940723.354890:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+67:11452:x1875839921750784:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 368us (5122us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1788940723.354899:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:2.0:1788940723.365615:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940723.366353:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921751040 00000100:00100000:0.0:1788940723.366369:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921751040 00000100:00100000:0.0:1788940723.366591:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 133 00000100:00100000:0.0:1788940723.366609:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+67:11452:x1875839921751040:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788940723.366783:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+67:11452:x1875839921751040:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 178us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.370206:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940723.370503:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921751168 00000100:00100000:2.0:1788940723.370518:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921751168 00000100:00100000:0.0:1788940723.373568:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 133 00000100:00100000:2.0:1788940723.376864:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 134 00000100:00100000:2.0:1788940723.376929:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+67:11452:x1875839921751168:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940723.376963:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940723.376998:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badda77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc73e8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.377095:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badda7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.377115:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badda7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.377130:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badda7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940723.377195:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788940723.378428:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badda7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.378571:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08badda77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73e8 expref: 69 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.378595:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badda7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73e8 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.378605:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:2.0:1788940723.378608:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788940723.378613:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7c00, rc 0) 00000100:00100000:2.0:1788940723.378839:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+68:11452:x1875839921751168:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1922us (8644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940723.378869:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 134 00000100:00100000:2.0:1788940723.382208:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940723.382560:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921751296 00000100:00100000:0.0:1788940723.382575:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921751296 00000100:00100000:1.0:1788940723.382776:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:1.0:1788940723.382789:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+9:2406:x1875839921751296:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940723.382812:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940723.382838:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08badda85 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc73ef expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940723.382870:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa111b4, blocks: 0x0 00010000:00010000:1.0:1788940723.382898:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=478s v=(0 0) 00010000:00010000:1.0:1788940723.382916:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940723.382929:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08badda85 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73ef expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.382953:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08badda85 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73ef expref: 10 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.382999:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603000, rc 0) 00000100:00100000:1.0:1788940723.383232:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+10:2406:x1875839921751296:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 444us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940723.383240:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:3.0:1788940723.392252:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940723.392500:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921751552 00000100:00100000:1.0:1788940723.392515:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921751552 00000100:00100000:1.0:1788940723.392636:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 135 00000100:00100000:1.0:1788940723.392649:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+68:11452:x1875839921751552:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788940723.392802:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+68:11452:x1875839921751552:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 155us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940723.392811:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 135 00000100:00100000:3.0:1788940723.404656:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940723.406343:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921751680 00000100:00100000:0.0:1788940723.406361:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921751680 00000100:00100000:0.0:1788940723.406440:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:0.0:1788940723.406453:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+10:11452:x1875839921751680:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940723.406478:0:8524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940723.406503:0:8524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095eac462/0x9c34acc08badda8c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc73f6 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.406547:0:8524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08badda85 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73ef expref: 11 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.406558:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940723.406563:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940723.406589:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095eac462/0x9c34acc08badda8c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73f6 expref: 11 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.406636:0:8524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08badda85 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73ef expref: 11 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.406651:0:8524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08badda85 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73ef expref: 11 pid: 8437 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940723.406669:0:8524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8524:1875839944905088:192.168.202.25@tcp:104: 00000100:00100000:0.0:1788940723.406854:0:8524:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06f4e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788940723.421396:0:8524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8524:1875839944905088:192.168.202.25@tcp:104: 00010000:00010000:0.0:1788940723.421452:0:8524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095eac462/0x9c34acc08badda8c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73f6 expref: 11 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.421493:0:8524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d000031e00, rc 0) 00000100:00100000:0.0:1788940723.421587:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+11:11452:x1875839921751680:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 15135us (16942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940723.421599:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:3.0:1788940723.425074:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940723.426112:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921751808 00000100:00100000:2.0:1788940723.426129:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921751808 00010000:00010000:2.0:1788940723.426191:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08badda85 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73ef expref: 11 pid: 8437 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940723.426313:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 73 00000100:00100000:2.0:1788940723.426327:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+11:2404:x1875839921751808:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940723.426348:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940723.426380:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08badda85 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73ef expref: 11 pid: 8437 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.426397:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08badda85 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73ef expref: 11 pid: 8437 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.426427:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08badda85 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73ef expref: 11 pid: 8437 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.426450:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940723.426455:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940723.426464:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095eac462/0x9c34acc08badda8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73f6 expref: 10 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.426476:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095eac462/0x9c34acc08badda8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73f6 expref: 10 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.426549:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000095eac462/0x9c34acc08badda8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73f6 expref: 10 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940723.426565:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6507:1875839944905216:192.168.202.25@tcp:105: 00000100:00100000:2.0:1788940723.426682:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0196ea0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940723.429304:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6507:1875839944905216:192.168.202.25@tcp:105: 00010000:00010000:2.0:1788940723.429342:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940723.429420:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+10:2404:x1875839921751808:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 3095us (4361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940723.429434:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 73 00000100:00100000:0.0:1788940723.433503:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940723.433609:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921751936 00000100:00100000:1.0:1788940723.433622:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921751936 00002000:00100000:1.0:1788940723.433688:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff91d0012ad880 x1875839921751936/t0(0) o4->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:699/0 lens 504/0 e 0 to 0 dl 1788940734 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940723.433702:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91d0012ad880 with x1875839921751936 ext(0->12) 00002000:00010000:1.0:1788940723.433709:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d0012ad880 00000100:00100000:1.0:1788940723.433748:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:1.0:1788940723.433759:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82f3b232-46da-4a78-8599-45df2ddbced0+10:2404:x1875839921751936:12345-192.168.202.25@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788940723.437625:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82f3b232-46da-4a78-8599-45df2ddbced0+12:2404:x1875839921751936:12345-192.168.202.25@tcp:4:lhsmtool_posix.0 Request processed in 3849us (4117us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788940723.437646:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 2 00002000:00100000:1.0:1788940723.437664:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff91d0012ad880 x1875839921751936/t4294967309(0) o4->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:699/0 lens 504/448 e 0 to 0 dl 1788940734 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940723.437694:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91d0012ad880 with x1875839921751936 ext(0->12) 00002000:00010000:1.0:1788940723.437703:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d0012ad880 00000100:00100000:2.0:1788940723.441638:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940723.441756:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921752064 00000100:00100000:0.0:1788940723.441769:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921752064 00000100:00100000:0.0:1788940723.441880:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 136 00000100:00100000:0.0:1788940723.441893:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+68:11452:x1875839921752064:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788940723.444428:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1788940723.444447:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1788940723.444499:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788940723.444526:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91d00508bf00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788940723.444532:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91d02005a500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91d00508b180 00000020:00080000:1.0:1788940723.444536:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91d02005ad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91cf085fde00 00000004:00080000:1.0:1788940723.444569:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788940723.444599:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91cf06f4e600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788940723.444603:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91d035993f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91cf06f4e0c0 00000020:00080000:1.0:1788940723.444606:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91d035993400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91cf085fca00 00000020:00080000:1.0:1788940723.444644:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788940723.444721:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788940723.444895:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+22:11452:x1875839921752064:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 Request processed in 2998us (3265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940723.444920:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 136 00000100:00100000:0.0:1788940723.444921:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944905344:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788940723.445017:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940723.445174:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944905344 00000100:00100000:1.0:1788940723.445184:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944905344 00000100:00100000:2.0:1788940723.445557:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788940723.445570:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875839944905344:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788940723.445601:0:8438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1788940723.445642:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa111b2, atime: 0x6aa111b2, ctime: 0x6aa111b2, blocks: 0x8 00010000:00010000:2.0:1788940723.445651:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b67eea61/0x9c34acc08badda93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.445671:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1788940723.445676:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940723.445683:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b67eea61/0x9c34acc08badda93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.445700:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b67eea61/0x9c34acc08badda93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.445716:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b67eea61/0x9c34acc08badda93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.445722:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b67eea61/0x9c34acc08badda93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.445741:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940723.445771:0:10401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940723.445778:0:10401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b67eea61/0x9c34acc08badda93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.445786:0:10401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940723.445791:0:10401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b67eea61/0x9c34acc08badda93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.445808:0:10401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b67eea61/0x9c34acc08badda93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.445827:0:10401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b67eea61/0x9c34acc08badda93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.445835:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b67eea61/0x9c34acc08badda93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.445856:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940723.445858:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940723.445859:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940723.445890:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1875839944905344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 323us (873us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788940723.445897:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788940723.445929:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940723.445940:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944905600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788940723.445976:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940723.446008:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944905600 00000100:00100000:1.0:1788940723.446014:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944905600 00000004:00080000:2.0:1788940723.446046:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d0012aea00/2, rc 0, transno 4294967305 00000100:00100000:1.0:1788940723.446049:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788940723.446054:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944905344:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788940723.446055:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875839944905600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788940723.446190:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940723.446197:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944905472:0@lo:6:osp-syn-0-0.0 00002000:00010000:1.0:1788940723.446204:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788940723.446207:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788940724 00002000:00010000:1.0:1788940723.446210:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788940723.446212:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788940724 -> 1788940724 00000100:00100000:2.0:1788940723.446312:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1788940723.446312:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788940723.446337:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944905472 00000100:00100000:2.0:1788940723.446342:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944905472 00000100:00100000:1.0:1788940723.446350:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3648:x1875839944905600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 295us (373us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788940723.446357:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:2.0:1788940723.446358:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91cf07845880/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788940723.446363:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944905600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788940723.446393:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788940723.446399:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1875839944905472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788940723.446421:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1788940723.446433:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08badda9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.446452:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0a91b69/0x9c34acc08badd847 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc734e expref: 11 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.446460:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788940723.446464:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940723.446468:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08badda9a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.446498:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e0a91b69/0x9c34acc08badd847 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc734e expref: 11 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.446515:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e0a91b69/0x9c34acc08badd847 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc734e expref: 11 pid: 8438 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940723.446528:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8437:1875839944905728:192.168.202.25@tcp:104: 00000100:00100000:2.0:1788940723.446588:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0196ea480 going to sleep for 11 seconds 00010000:00010000:3.0:1788940723.447133:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd791 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.447145:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd791 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.447162:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd791 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.447168:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940723.447172:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd791 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.447179:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd791 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.447193:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91cf06dfe000) 00010000:00010000:3.0:1788940723.447197:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940723.447202:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd791 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.447208:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badd791 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788940723.448433:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788940723.448682:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd839 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448698:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd839 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448705:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd839 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448712:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000030e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940723.448716:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd839 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448741:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd839 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448753:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91d00293a700) 00010000:00010000:3.0:1788940723.448755:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940723.448760:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd839 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448764:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badd839 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448783:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd8b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448787:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd8b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448791:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd8b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448794:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940723.448795:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd8b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448798:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd8b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448802:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d00293af00) 00010000:00010000:3.0:1788940723.448803:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940723.448805:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd8b7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448813:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6400/0x9c34acc08badd8b7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448822:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd8da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448825:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd8da lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448829:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd8da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448832:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940723.448834:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd8da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448837:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd8da lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448841:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91d00293af00) 00010000:00010000:3.0:1788940723.448843:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940723.448844:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd8da lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448847:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08badd8da lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448856:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd9ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448859:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd9ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448866:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd9ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448870:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940723.448871:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd9ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448875:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd9ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448879:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:3.0:1788940723.448880:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940723.448882:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd9ac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448885:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badd9ac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448893:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badda69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448897:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badda69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448912:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badda69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448918:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000030200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940723.448921:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badda69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448941:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badda69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448951:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:3.0:1788940723.448953:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788940723.448956:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badda69 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.448962:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08badda69 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940723.449985:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940723.450116:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921752192 00000100:00100000:1.0:1788940723.450130:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921752192 00000100:00100000:1.0:1788940723.450237:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:1.0:1788940723.450248:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+12:2405:x1875839921752192:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788940723.452519:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1788940723.452539:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1788940723.462351:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940723.462886:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921752320 00000100:00100000:3.0:1788940723.462912:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921752320 00010000:00010000:3.0:1788940723.462972:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a91b69/0x9c34acc08badd847 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc734e expref: 8 pid: 8438 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.463033:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 74 00000100:00100000:3.0:1788940723.463044:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+8:2404:x1875839921752320:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940723.463074:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940723.463080:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e0a91b69/0x9c34acc08badd847 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc734e expref: 8 pid: 8438 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.463097:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e0a91b69/0x9c34acc08badd847 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc734e expref: 8 pid: 8438 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.463158:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940723.463164:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940723.463171:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08badda9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.463182:0:7474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08badda9a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.463209:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940723.463311:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+8:2404:x1875839921752320:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 269us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.463320:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 74 00010000:00010000:2.0:1788940723.464023:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0a91b69/0x9c34acc08badd847 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc734e expref: 7 pid: 8438 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940723.464047:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8437:1875839944905728:192.168.202.25@tcp:104: 00010000:00010000:2.0:1788940723.464133:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08badda9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.464146:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08badda9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.464154:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08badda9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.464166:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08badda9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.464176:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08badda9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.464294:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788940723.464496:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:2405:x1875839921752192:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 Request processed in 14249us (14519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940723.464507:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:3.0:1788940723.469980:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940723.470435:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921752576 00000100:00100000:3.0:1788940723.470454:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921752576 00000100:00100000:3.0:1788940723.470543:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 137 00000100:00100000:3.0:1788940723.470556:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+16:11452:x1875839921752576:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788940723.470636:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940723.470679:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badda7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73e8 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.470705:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:3.0:1788940723.470712:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940723.470759:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddaa1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.470798:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddaa1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.470811:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddaa1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940723.471001:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e543316e reply state 00000000a85bb6bf transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddaa1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.471015:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddaa1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.471022:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:3.0:1788940723.471025:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788940723.471028:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940723.471175:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+17:11452:x1875839921752576:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 620us (1214us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1788940723.471182:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 137 00010000:00010000:0.0:1788940723.472851:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940723.472871:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08badda9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.472887:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940723.472893:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08badda9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.472916:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08badda9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.472948:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08badda9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.472957:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08badda9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.473084:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940723.473087:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940723.473089:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940723.477883:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875839944905472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31471us (31557us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788940723.477920:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788940723.478494:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788940723.478505:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:0.0:1788940723.478533:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91cf07845880, transno 4294967310 00000100:00100000:0.0:1788940723.478552:0:3645:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff91cf08c98a80 x1875839944905472/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788940739 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788940723.478595:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91cf08c98a80/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788940723.478602:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944905472:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788940723.482295:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940723.482389:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921752704 00000100:00100000:2.0:1788940723.482403:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921752704 00000100:00100000:2.0:1788940723.482483:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:2.0:1788940723.482496:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:2406:x1875839921752704:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788940723.482719:0:8524:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788940723.482724:0:8524:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788940724 -> 1788940722 00002000:00010000:2.0:1788940723.482727:0:8524:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788940722 00002000:00010000:2.0:1788940723.482746:0:8524:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788940724 -> 1788940722 00002000:00010000:2.0:1788940723.482749:0:8524:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788940723.482829:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+7:2406:x1875839921752704:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 334us (579us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788940723.482838:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 52 00010000:00010000:3.0:1788940723.484438:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940723.488350:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940723.488707:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921752960 00000100:00100000:1.0:1788940723.488722:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921752960 00000100:00100000:1.0:1788940723.488808:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 138 00000100:00100000:1.0:1788940723.488820:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+17:11452:x1875839921752960:12345-192.168.202.25@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788940723.488934:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddaa8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.488959:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badda62 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73da expref: 17 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.488971:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddaa8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.489019:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badda62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73da expref: 17 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.489034:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badda62 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73da expref: 17 pid: 8517 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940723.489050:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0874bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944905856:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940723.489166:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940723.493387:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940723.493625:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921753088 00000100:00100000:3.0:1788940723.493647:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921753088 00010000:00010000:3.0:1788940723.493700:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badda62 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73da expref: 18 pid: 8517 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.493751:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 75 00000100:00100000:3.0:1788940723.493762:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+18:2404:x1875839921753088:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940723.493962:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940723.493981:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badda62 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73da expref: 18 pid: 8517 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.494020:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badda62 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73da expref: 18 pid: 8517 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.494049:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:3.0:1788940723.494056:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddaa8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.494068:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddaa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.494079:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddaa8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.494105:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940723.494181:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+18:2404:x1875839921753088:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 420us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.494190:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 75 00010000:00010000:1.0:1788940723.495207:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08badda62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73da expref: 17 pid: 8517 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940723.495311:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0874bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944905856:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940723.495342:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddaa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.495353:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddaa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.495359:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddaa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.495413:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddaa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.495421:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddaa8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.495428:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddaa8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.495435:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940723.495439:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddaa8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.495447:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddaa8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.495652:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:1.0:1788940723.495657:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788940723.495663:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddaa8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.495678:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddaa8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940723.495761:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+16:11452:x1875839921752960:12345-192.168.202.25@tcp:55:lhsmtool_posix.0 Request processed in 6942us (7425us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788940723.495772:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 138 00000100:00100000:0.0:1788940723.499555:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940723.500142:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921753216 00000100:00100000:1.0:1788940723.500157:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921753216 00000100:00100000:1.0:1788940723.500439:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:1.0:1788940723.500454:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921753216:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788940723.500531:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08baddaaf lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.500559:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095eac462/0x9c34acc08badda8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73f6 expref: 7 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.500569:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940723.500575:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788940723.500581:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08baddaaf lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.500643:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095eac462/0x9c34acc08badda8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73f6 expref: 7 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.500660:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095eac462/0x9c34acc08badda8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73f6 expref: 7 pid: 8524 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940723.500705:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0874bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8439:1875839944905984:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940723.500827:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940723.504655:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940723.504800:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0874bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8439:1875839944905984:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940723.504838:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08baddaaf lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.505484:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921753344 00000100:00100000:3.0:1788940723.505495:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921753344 00010000:00010000:3.0:1788940723.505546:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095eac462/0x9c34acc08badda8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73f6 expref: 8 pid: 8524 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.505591:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 76 00000100:00100000:3.0:1788940723.505600:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+8:2405:x1875839921753344:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940723.505619:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940723.505657:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095eac462/0x9c34acc08badda8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73f6 expref: 8 pid: 8524 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.505696:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095eac462/0x9c34acc08badda8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73f6 expref: 8 pid: 8524 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.505723:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095eac462/0x9c34acc08badda8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73f6 expref: 8 pid: 8524 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.505745:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940723.505750:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940723.505757:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08baddaaf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.505768:0:7474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08baddaaf lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.506155:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940723.506237:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921753344:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 636us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940723.506247:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 76 00010000:00010000:3.0:1788940723.509074:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08baddaaf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.509102:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08baddaaf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.509143:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08baddaaf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.509150:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08baddaaf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.509187:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08baddaaf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.509195:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602e00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940723.509201:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08baddaaf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.509211:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08baddaaf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.509705:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08baddaaf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.509714:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08baddaaf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940723.510494:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:2405:x1875839921753216:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 Request processed in 10033us (10943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940723.510508:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:0.0:1788940723.515749:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940723.515951:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921753600 00000100:00100000:1.0:1788940723.515967:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921753600 00000100:00100000:1.0:1788940723.516049:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 139 00000100:00100000:1.0:1788940723.516068:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+16:11452:x1875839921753600:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788940723.516187:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddab6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.516220:0:8517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd9a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73a2 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.516233:0:8517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddab6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.516318:0:8517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd9a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73a2 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.516358:0:8517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd9a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73a2 expref: 16 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940723.516385:0:8517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0874bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944906112:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940723.516508:0:8517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940723.521765:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940723.521914:0:8517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0874bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944906112:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940723.521950:0:8517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddab6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.522083:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921753728 00000100:00100000:3.0:1788940723.522094:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921753728 00010000:00010000:3.0:1788940723.522146:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd9a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73a2 expref: 17 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.522196:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 77 00000100:00100000:3.0:1788940723.522207:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+17:2405:x1875839921753728:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940723.522235:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940723.522244:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd9a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73a2 expref: 17 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.522327:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd9a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73a2 expref: 17 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.522357:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08badd9a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73a2 expref: 17 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.522375:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:3.0:1788940723.522382:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badda07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73c5 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.522394:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddab6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.522402:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddab6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.522413:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddab6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.522438:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940723.522526:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+16:2405:x1875839921753728:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 320us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.522534:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 77 00010000:00010000:0.0:1788940723.523054:0:8517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddab6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.523064:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddab6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.523391:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08baddabd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.523408:0:8517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08badda70 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73e1 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.523417:0:8517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08baddabd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.523471:0:8517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08badda70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73e1 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.523502:0:8517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08badda70 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73e1 expref: 16 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940723.523519:0:8517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037887b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944906240:192.168.202.25@tcp:104: 00000100:00100000:0.0:1788940723.523620:0:8517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06f4e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788940723.527546:0:8517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037887b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944906240:192.168.202.25@tcp:104: 00010000:00010000:0.0:1788940723.527591:0:8517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08baddabd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940723.529805:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940723.531087:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921753856 00000100:00100000:1.0:1788940723.531104:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921753856 00010000:00010000:1.0:1788940723.531170:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08badda70 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73e1 expref: 17 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940723.531395:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 78 00000100:00100000:1.0:1788940723.531408:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+17:2405:x1875839921753856:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940723.531428:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940723.531437:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08badda70 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73e1 expref: 17 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.531453:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08badda70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73e1 expref: 17 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.531494:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08badda70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73e1 expref: 17 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.531541:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:1.0:1788940723.531548:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08baddabd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.531559:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08baddabd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.531569:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08baddabd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.531614:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940723.531711:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+16:2405:x1875839921753856:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 304us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940723.531719:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 78 00010000:00010000:2.0:1788940723.531791:0:8517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08baddabd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.531801:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08baddabd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940723.532008:0:8517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1788940723.532169:0:8517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1788940723.532229:0:8517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1788940723.532379:0:8517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8517:1875839944906368:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788940723.532451:0:8517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940723.532491:0:8517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d024a26000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940723.532523:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944906368 00000100:00100000:2.0:1788940723.532530:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944906368 00000100:00100000:2.0:1788940723.532575:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788940723.532583:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8517:x1875839944906368:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788940723.532676:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8517:x1875839944906368:12345-0@lo:1000:mdt00_003.0 Request processed in 94us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940723.532684:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788940723.532738:0:8517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8517:1875839944906368:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788940723.532942:0:8517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1788940723.532999:0:8517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8517:1875839944906496:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788940723.533034:0:8517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940723.533052:0:8517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359e2480 going to sleep for 11 seconds 00000100:00100000:0.0:1788940723.535148:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944906496 00000100:00100000:0.0:1788940723.535170:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944906496 00000100:00100000:0.0:1788940723.535252:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788940723.535289:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8517:x1875839944906496:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788940723.535560:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8517:x1875839944906496:12345-0@lo:1000:mdt00_003.0 Request processed in 274us (2524us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788940723.535568:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788940723.535802:0:8517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8517:1875839944906496:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788940723.535865:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08baddabd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.535877:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08baddabd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.535912:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08baddabd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.535920:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000030200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940723.535925:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08baddabd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.535935:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08baddabd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.535956:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:3.0:1788940723.535959:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940723.535965:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08baddabd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.535972:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030200/0x9c34acc08baddabd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.536005:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badda00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.536013:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badda00 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.536020:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badda00 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.536026:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940723.536029:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badda00 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.536046:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badda00 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.536055:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:3.0:1788940723.536058:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940723.536066:0:8517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badda07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73c5 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.536080:0:8517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badda07 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73c5 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.536091:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badda07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73c5 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.536133:0:8517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badda07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73c5 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.536149:0:8517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944906624:192.168.202.25@tcp:105: 00000100:00100000:3.0:1788940723.536247:0:8517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a4a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788940723.539879:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940723.540012:0:8517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944906624:192.168.202.25@tcp:105: 00010000:00010000:0.0:1788940723.540048:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badda00 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.540061:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08badda00 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.540111:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddac4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.540153:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddac4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.540170:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddac4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.540186:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddac4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.540193:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddac4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.540201:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddac4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.540207:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940723.540221:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddac4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.540231:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddac4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.540243:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:0.0:1788940723.540246:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940723.540251:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddac4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.540288:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddac4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.540300:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddab6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.540313:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddab6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.540319:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddab6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.540325:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940723.540329:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddab6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.540336:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddab6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.540345:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:0.0:1788940723.540348:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788940723.540351:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddab6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.540357:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddab6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940723.540568:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+19:11452:x1875839921753600:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 24507us (24832us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788940723.540581:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 139 00000020:00080000:0.0:1788940723.540588:0:8517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788940723.542972:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940723.542985:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788940723.543606:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921753984 00000100:00100000:2.0:1788940723.543634:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921753984 00000100:00100000:2.0:1788940723.543729:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:2.0:1788940723.543742:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+19:11451:x1875839921753984:12345-192.168.202.25@tcp:49:lfs.0 00000100:00100000:2.0:1788940723.543951:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+19:11451:x1875839921753984:12345-192.168.202.25@tcp:49:lfs.0 Request processed in 210us (4086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940723.543961:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 31 00000040:00080000:3.0:1788940723.544735:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788940723.544753:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788940723.545912:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940723.548015:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921754240 00000100:00100000:2.0:1788940723.548038:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921754240 00000100:00100000:2.0:1788940723.548127:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 32 00000100:00100000:2.0:1788940723.548140:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d002e66450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+19:11452:x1875839921754240:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788940723.548555:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788940723.548597:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1788940723.548768:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddacb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.548792:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddacb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.548808:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddacb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.548819:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddacb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.548827:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddacb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.548856:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddacb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.548884:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788940723.549034:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d002e66450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+21:11452:x1875839921754240:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 893us (3141us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788940723.549044:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 32 00000020:00080000:2.0:1788940723.549050:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788940723.549134:0:10401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940723.549142:0:10401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddacb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.549149:0:10401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7600 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940723.549154:0:10401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddacb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.549164:0:10401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddacb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.549180:0:10401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:2.0:1788940723.549182:0:10401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788940723.549189:0:10401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddacb lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.549195:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddacb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.549209:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940723.549220:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940723.549222:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940723.552862:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940723.553054:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921754496 00000100:00100000:3.0:1788940723.553068:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921754496 00000100:00100000:3.0:1788940723.553183:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 140 00000100:00100000:3.0:1788940723.553197:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+21:11451:x1875839921754496:12345-192.168.202.25@tcp:58:lfs.0 00000040:00080000:3.0:1788940723.553533:0:9713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788940723.553661:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+21:11451:x1875839921754496:12345-192.168.202.25@tcp:58:lfs.0 Request processed in 467us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.553670:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 140 00000100:00100000:3.0:1788940723.579194:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940723.579325:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921754624 00000100:00100000:1.0:1788940723.579339:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921754624 00000100:00100000:1.0:1788940723.579409:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 141 00000100:00100000:1.0:1788940723.579420:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+21:11454:x1875839921754624:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788940723.579453:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940723.579489:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddad2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc73fd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.579575:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddad9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.579594:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddad9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.579608:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddad9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.579650:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddae0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.579658:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.579665:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.579751:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08baddae7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.579763:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd9f2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73be expref: 22 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.579772:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08baddae7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.579813:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd9f2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73be expref: 22 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.579829:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd9f2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73be expref: 22 pid: 9713 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940723.579846:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0874bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944906752:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940723.579961:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940723.585809:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940723.585918:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921754880 00000100:00100000:2.0:1788940723.585931:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921754880 00000100:00100000:2.0:1788940723.586012:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:2.0:1788940723.586024:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+23:6659:x1875839921754880:12345-192.168.202.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788940723.586382:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+24:6659:x1875839921754880:12345-192.168.202.25@tcp:35:ldlm_bl.0 Request processed in 359us (585us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788940723.586391:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:1.0:1788940723.587485:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0874bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944906752:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940723.587524:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08baddae7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940723.589566:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940723.589776:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921755008 00000100:00100000:3.0:1788940723.589790:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921755008 00010000:00010000:3.0:1788940723.589850:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd9f2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73be expref: 24 pid: 9713 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.589916:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 79 00000100:00100000:3.0:1788940723.589931:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+24:2404:x1875839921755008:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940723.589952:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940723.589961:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd9f2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73be expref: 24 pid: 9713 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.589991:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd9f2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73be expref: 24 pid: 9713 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.590022:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badd9f2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73be expref: 24 pid: 9713 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.590046:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:3.0:1788940723.590052:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08baddae7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.590063:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08baddae7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.590091:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08baddae7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.590138:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940723.590420:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+23:2404:x1875839921755008:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 284us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.590431:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 79 00010000:00010000:2.0:1788940723.590580:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08baddae7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.590590:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08baddae7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940723.590726:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788940723.590732:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788940723.590760:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08baddae7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.590775:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08baddae7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.590789:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddad9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.590797:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddad9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.590805:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddad9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.590812:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940723.590826:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddad9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.590836:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddad9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.590847:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:2.0:1788940723.590850:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940723.590855:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddad9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.590862:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddad9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.590878:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.590884:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddae0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.590891:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddae0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.590896:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940723.590910:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddae0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.590917:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddae0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.590925:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91cf06dfa200) 00010000:00010000:2.0:1788940723.590927:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940723.590937:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddae0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.590944:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddae0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.591072:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddad2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73fd expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.591090:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08baddae7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73fd expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940723.591097:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:2.0:1788940723.591100:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940723.591102:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602400, rc 0) 00000100:00100000:2.0:1788940723.591143:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+22:11454:x1875839921754624:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 11725us (11966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940723.591151:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 141 00000100:00100000:3.0:1788940723.868613:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944906880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940723.868733:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940723.868944:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944906880 00000100:00100000:0.0:1788940723.868984:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944906880 00000100:00100000:0.0:1788940723.869069:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788940723.869083:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944906880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788940723.869127:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788940723.869190:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944906880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940723.869198:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788940723.869293:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944906880:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788940723.869422:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940723.871424:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940723.871449:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944907008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940723.871549:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940723.872050:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944907008 00000100:00100000:2.0:1788940723.872062:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944907008 00000100:00100000:2.0:1788940723.872129:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788940723.872140:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0874bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875839944907008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940723.872168:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788940723.872249:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0874bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875839944907008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940723.872282:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788940723.872716:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944907008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940723.882123:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940723.882153:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944907136:0@lo:400:kworker.0 00000100:00100000:3.0:1788940723.882863:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940723.883093:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944907136 00000100:00100000:1.0:1788940723.883106:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944907136 00000100:00100000:1.0:1788940723.883179:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1788940723.883191:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944907136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940723.883312:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3645:x1875839944907136:12345-0@lo:400:kworker.0 Request processed in 123us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940723.883321:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788940723.883698:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944907136:0@lo:400:kworker.0 00000100:00100000:3.0:1788940723.883792:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944907520:0@lo:400:kworker.0 00000100:00100000:3.0:1788940723.883836:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940723.883883:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940723.883890:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944907648:0@lo:400:kworker.0 00000100:00100000:3.0:1788940723.883943:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940723.884077:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944907520 00000100:00100000:0.0:1788940723.884084:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944907520 00000100:00100000:0.0:1788940723.884131:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788940723.884140:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944907520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940723.884190:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944907520:12345-0@lo:400:kworker.0 Request processed in 53us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940723.884197:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788940723.884242:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944907392:0@lo:400:kworker.0 00000100:00100000:0.0:1788940723.884297:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940723.884349:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944907264:0@lo:400:kworker.0 00000100:00100000:1.0:1788940723.884380:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940723.903715:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944907520:0@lo:400:kworker.0 00000100:00100000:2.0:1788940723.906499:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944907648 00000100:00100000:2.0:1788940723.906517:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944907648 00000100:00100000:2.0:1788940723.906577:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944907392 00000100:00100000:2.0:1788940723.906601:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944907392 00000100:00100000:2.0:1788940723.906638:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788940723.906649:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039973050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944907648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940723.906770:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039973050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944907648:12345-0@lo:400:kworker.0 Request processed in 124us (22827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940723.906778:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788940723.907431:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788940723.907442:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944907392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940723.907494:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944907392:12345-0@lo:400:kworker.0 Request processed in 55us (23195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940723.907501:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788940723.914973:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944907264 00000100:00100000:3.0:1788940723.914997:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944907264 00000100:00100000:3.0:1788940723.915075:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788940723.915087:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944907264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940723.916859:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944907392:0@lo:400:kworker.0 00000100:00100000:3.0:1788940723.917596:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944907264:12345-0@lo:400:kworker.0 Request processed in 2506us (33209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.917699:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788940723.917765:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944907648:0@lo:400:kworker.0 00000100:00100000:0.0:1788940723.917844:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940723.917894:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944907904:0@lo:400:kworker.0 00000100:00100000:1.0:1788940723.917948:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944907264:0@lo:400:kworker.0 00000100:00100000:0.0:1788940723.918000:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940723.918036:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944907776:0@lo:400:kworker.0 00000100:00100000:0.0:1788940723.918062:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940723.918551:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944908160:0@lo:400:kworker.0 00000100:00100000:0.0:1788940723.918590:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940723.918636:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940723.918642:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944908032:0@lo:400:kworker.0 00000100:00100000:0.0:1788940723.918669:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940723.918700:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944908160 00000100:00100000:0.0:1788940723.918709:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944908160 00000100:00100000:0.0:1788940723.918763:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944908032 00000100:00100000:0.0:1788940723.918766:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944908032 00000100:00100000:0.0:1788940723.918798:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788940723.918808:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3646:x1875839944908160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940723.918861:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3646:x1875839944908160:12345-0@lo:400:kworker.0 Request processed in 54us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940723.918867:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788940723.918883:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788940723.918889:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944908032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940723.918935:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944908032:12345-0@lo:400:kworker.0 Request processed in 46us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940723.918941:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788940723.921068:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944908032:0@lo:400:kworker.0 00000100:00100000:0.0:1788940723.921132:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944908160:0@lo:400:kworker.0 00000100:00100000:0.0:1788940723.921196:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944908416:0@lo:400:kworker.0 00000100:00100000:0.0:1788940723.921416:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940723.922854:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940723.922873:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839944908288:0@lo:400:kworker.0 00000100:00100000:0.0:1788940723.922945:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940723.923038:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944907904 00000100:00100000:3.0:1788940723.923049:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944907904 00000100:00100000:3.0:1788940723.923117:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944907776 00000100:00100000:3.0:1788940723.923121:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944907776 00000100:00100000:3.0:1788940723.923143:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944908416 00000100:00100000:3.0:1788940723.923146:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944908416 00000100:00100000:3.0:1788940723.923165:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788940723.923175:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944907904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940723.923253:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944907904:12345-0@lo:400:kworker.0 Request processed in 79us (5254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.923279:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788940723.923301:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788940723.923308:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944907776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940723.923339:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944907776:12345-0@lo:400:kworker.0 Request processed in 32us (5277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.923344:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788940723.923355:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788940723.923360:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944908416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940723.923384:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944908416:12345-0@lo:400:kworker.0 Request processed in 25us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.923389:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00080000:3.0:1788940723.923428:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940723.923433:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788940723.923436:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788940723.924131:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06f65f80 x1875839944908416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940723.924165:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944908416:0@lo:400:kworker.0 00010000:00080000:0.0:1788940723.924183:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a2fb80 x1875839944907904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940723.924192:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944907904:0@lo:400:kworker.0 00000100:00100000:0.0:1788940723.924386:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944907776:0@lo:400:kworker.0 00000100:00100000:3.0:1788940723.924670:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944908288 00000100:00100000:3.0:1788940723.924678:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944908288 00000100:00100000:3.0:1788940723.924730:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788940723.924739:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839944908288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940723.924808:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839944908288:12345-0@lo:400:kworker.0 Request processed in 69us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.924816:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00080000:3.0:1788940723.924838:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940723.925314:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839944908288:0@lo:400:kworker.0 00010000:00010000:0.0:1788940724.509000:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940724.581330:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788940724.581346:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940724.581395:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788940724.581407:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788940724.581602:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08748380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1875839944908544:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788940724.581726:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd000 going to sleep for 11 seconds 00000100:00100000:3.0:1788940724.596800:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940724.596849:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921755136 00000100:00100000:3.0:1788940724.596861:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921755136 00000100:00100000:3.0:1788940724.596944:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 142 00000100:00100000:3.0:1788940724.596957:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+23:11465:x1875839921755136:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788940724.597012:0:9713:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788940724.597186:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+23:11465:x1875839921755136:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 229us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940724.597194:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 142 00000100:00100000:3.0:1788940724.597375:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08748380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1875839944908544:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788940724.600153:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940724.600206:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921755392 00000100:00100000:3.0:1788940724.600219:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921755392 00000100:00100000:3.0:1788940724.600318:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 143 00000100:00100000:3.0:1788940724.600332:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+22:11465:x1875839921755392:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940724.600366:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940724.600402:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddaee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7404 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940724.600591:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08baddaf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940724.600612:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08baddaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940724.600628:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08baddaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940724.600641:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788940724.600794:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddaee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7404 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940724.600816:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08baddaf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7404 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940724.600826:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:3.0:1788940724.600830:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940724.600834:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936000, rc 0) 00000100:00100000:3.0:1788940724.600920:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+24:11465:x1875839921755392:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 591us (782us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788940724.600933:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 143 00000100:00100000:3.0:1788940724.609150:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940724.609971:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940724.610215:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921755776 00000100:00100000:2.0:1788940724.610231:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921755776 00000100:00100000:2.0:1788940724.610345:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 144 00000100:00100000:2.0:1788940724.610358:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+24:11465:x1875839921755776:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788940724.610576:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddb03 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940724.610600:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddb03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940724.610616:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddb03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940724.610905:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddb03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940724.610915:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddb03 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940724.610934:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddb03 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940724.610940:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940724.610946:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddb03 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940724.610955:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddb03 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940724.610971:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:2.0:1788940724.610974:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788940724.610980:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddb03 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940724.610987:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddb03 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940724.611195:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+25:11465:x1875839921755776:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 838us (1226us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788940724.611206:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 144 00000100:00100000:0.0:1788940724.613066:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921755520 00000100:00100000:0.0:1788940724.613085:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921755520 00000100:00100000:0.0:1788940724.613175:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:0.0:1788940724.613187:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+25:2405:x1875839921755520:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940724.613208:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940724.613240:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08baddaf5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7404 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940724.613273:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:0.0:1788940724.613279:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940724.613348:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+24:2405:x1875839921755520:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 163us (4214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940724.613356:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 10 00000040:00080000:3.0:1788940724.616390:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940724.616404:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940724.616902:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788940724.616925:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788940724.623589:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940724.623658:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921756032 00000100:00100000:2.0:1788940724.623671:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921756032 00000100:00100000:2.0:1788940724.623737:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00100000:2.0:1788940724.623749:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+24:11465:x1875839921756032:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788940724.624059:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+25:11465:x1875839921756032:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 311us (480us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788940724.624067:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 34 00000040:00080000:3.0:1788940724.755629:0:14319:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940724.755643:0:14319:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940724.755686:0:14319:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788940724.755696:0:14319:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788940724.891990:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788940724.962687:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940724.963374:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921756288 00000100:00100000:1.0:1788940724.963388:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921756288 00000100:00100000:1.0:1788940724.963461:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 145 00000100:00100000:1.0:1788940724.963475:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+25:11478:x1875839921756288:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788940724.963518:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940724.963547:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddb0a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc740b expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940724.963693:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08baddb11 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940724.963710:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08baddb11 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940724.963725:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08baddb11 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940724.963737:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788940724.963884:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddb0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc740b expref: 28 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940724.963919:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08baddb11 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc740b expref: 27 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940724.963928:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:1.0:1788940724.963932:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788940724.963937:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603e00, rc 0) 00000100:00100000:1.0:1788940724.964020:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+27:11478:x1875839921756288:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 548us (1348us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788940724.964028:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 145 00000100:00100000:2.0:1788940724.972720:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940724.973901:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921756416 00000100:00100000:3.0:1788940724.973919:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921756416 00000100:00100000:3.0:1788940724.974412:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 146 00000100:00100000:3.0:1788940724.974425:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+27:11478:x1875839921756416:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:3.0:1788940724.974529:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940724.974551:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940724.974566:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940724.974610:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940724.974618:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb1f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940724.974626:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940724.974632:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940724.974637:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940724.974658:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb1f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940724.974671:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:3.0:1788940724.974674:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788940724.974680:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb1f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940724.974687:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940724.978228:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+27:11478:x1875839921756416:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 3786us (5504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940724.978247:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 146 00000100:00100000:3.0:1788940725.115577:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940725.119554:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921756544 00000100:00100000:0.0:1788940725.119577:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921756544 00000100:00100000:0.0:1788940725.119826:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:0.0:1788940725.119842:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921756544:12345-192.168.202.25@tcp:101:cat.0 00010000:00010000:0.0:1788940725.119898:0:8524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940725.119930:0:8524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e206da54/0x9c34acc08baddb26 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7412 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940725.119965:0:8524:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa111b2, atime: 0x6aa111b2, ctime: 0x6aa111b2, blocks: 0x8 00010000:00010000:0.0:1788940725.120153:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788940725.120161:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940725.120173:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e206da54/0x9c34acc08baddb26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7412 expref: 7 pid: 8524 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940725.120199:0:8524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e206da54/0x9c34acc08baddb26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7412 expref: 7 pid: 8524 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940725.120770:0:8524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d000030200, rc 0) 00000100:00080000:3.0:1788940725.120967:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940725.121083:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+7:2404:x1875839921756544:12345-192.168.202.25@tcp:101:cat.0 Request processed in 1244us (5521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940725.121092:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:3.0:1788940725.134790:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940725.134912:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921756672 00000100:00100000:2.0:1788940725.134923:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921756672 00002000:00100000:2.0:1788940725.134975:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff91d037875f80 x1875839921756672/t0(0) o3->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:701/0 lens 488/0 e 0 to 0 dl 1788940736 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788940725.134985:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91d037875f80 with x1875839921756672 ext(0->4095) 00002000:00010000:2.0:1788940725.134990:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d037875f80 00000100:00100000:2.0:1788940725.135025:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:2.0:1788940725.135035:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921756672:12345-192.168.202.25@tcp:3:cat.0 00000100:00100000:2.0:1788940725.135310:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921756672:12345-192.168.202.25@tcp:3:cat.0 Request processed in 276us (531us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788940725.135316:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 3 00002000:00100000:2.0:1788940725.135322:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff91d037875f80 x1875839921756672/t0(0) o3->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:701/0 lens 488/4536 e 0 to 0 dl 1788940736 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788940725.135330:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91d037875f80 with x1875839921756672 ext(0->4095) 00002000:00010000:2.0:1788940725.135333:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d037875f80 00010000:00010000:3.0:1788940725.534198:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940726.429793:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944908672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940726.429882:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940726.430455:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944908672 00000100:00100000:2.0:1788940726.430465:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944908672 00000100:00100000:2.0:1788940726.431797:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788940726.431817:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944908672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940726.431863:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788940726.431978:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944908672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 167us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940726.431986:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788940726.437900:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944908672:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788940726.555686:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940726.566112:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940726.566163:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940726.566189:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940726.566211:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940726.566233:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940726.566250:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940726.566300:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940726.566330:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921757056 00000100:00100000:3.0:1788940726.566342:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921757056 00000100:00100000:3.0:1788940726.566400:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921757568 00000100:00100000:3.0:1788940726.566403:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921757568 00000100:00100000:3.0:1788940726.566437:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921756928 00000100:00100000:3.0:1788940726.566447:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921756928 00000100:00100000:3.0:1788940726.566462:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921757440 00000100:00100000:3.0:1788940726.566465:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921757440 00000100:00100000:3.0:1788940726.566494:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 356 00000100:00100000:3.0:1788940726.566505:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921757056:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940726.566578:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921757056:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 75us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940726.566586:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 356 00000100:00100000:3.0:1788940726.566616:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 357 00000100:00100000:3.0:1788940726.566623:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2406:x1875839921757568:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940726.566648:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2406:x1875839921757568:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 26us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940726.566654:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 357 00000100:00100000:3.0:1788940726.566668:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 358 00000100:00100000:3.0:1788940726.566674:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+27:2406:x1875839921756928:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940726.566699:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+27:2406:x1875839921756928:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 25us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940726.566705:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 358 00000100:00100000:3.0:1788940726.566793:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 359 00000100:00100000:3.0:1788940726.566801:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2406:x1875839921757440:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940726.566827:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2406:x1875839921757440:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940726.566833:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 359 00000100:00100000:3.0:1788940726.566858:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921757312 00000100:00100000:3.0:1788940726.566868:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921757312 00000100:00100000:3.0:1788940726.566908:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921757184 00000100:00100000:3.0:1788940726.566912:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921757184 00000100:00100000:3.0:1788940726.566930:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 133 00000100:00100000:3.0:1788940726.566937:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:2406:x1875839921757312:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940726.566967:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:2406:x1875839921757312:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 31us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940726.566973:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 133 00000100:00100000:3.0:1788940726.566986:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 134 00000100:00100000:3.0:1788940726.566992:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:2406:x1875839921757184:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940726.567017:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:2406:x1875839921757184:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 25us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940726.567023:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 134 00000100:00080000:3.0:1788940726.567048:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940726.567052:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940726.567054:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788940726.567749:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921756800 00000100:00100000:0.0:1788940726.567756:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921756800 00000100:00100000:0.0:1788940726.567789:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 397 00000100:00100000:0.0:1788940726.567797:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2406:x1875839921756800:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940726.567835:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2406:x1875839921756800:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 39us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940726.567850:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 397 00000100:00100000:1.0:1788940726.940191:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0874b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944908800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940726.940286:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940726.940368:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944908800 00000100:00100000:1.0:1788940726.940378:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944908800 00000100:00100000:1.0:1788940726.940434:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788940726.940443:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0874aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944908800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788940726.940474:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788940726.940517:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0874aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944908800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940726.940524:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788940726.940571:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0874b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944908800:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788940726.940770:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940726.940929:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944908928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940726.940956:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940726.946584:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944908928 00000100:00100000:3.0:1788940726.947643:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944908928 00000100:00100000:2.0:1788940726.947805:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788940726.947817:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0874b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875839944908928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940726.947846:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788940726.947936:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0874b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875839944908928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (6979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940726.947943:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788940726.948180:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944908928:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788940726.948343:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788940727.458791:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1788940727.458819:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:0.0:1788940727.579460:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940727.969072:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940727.974104:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944909056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940727.974193:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940727.974289:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944909056 00000100:00100000:1.0:1788940727.974299:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944909056 00000100:00100000:1.0:1788940727.974349:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788940727.974359:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944909056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788940727.974398:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788940727.974469:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944909056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940727.974477:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788940727.974532:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944909056:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788940728.603873:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940728.993627:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944909184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940728.993711:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940728.993789:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944909184 00000100:00100000:2.0:1788940728.993797:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944909184 00000100:00100000:2.0:1788940728.993867:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788940728.993877:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944909184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940728.993914:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940728.993962:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944909184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940728.993970:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1788940728.993995:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940728.994028:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1788940728.994036:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1788940728.994061:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d0012aea00, transno 4294967305 00000100:00100000:2.0:1788940728.994083:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944909184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940728.994834:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944909440:0@lo:400:kworker.0 00000100:00100000:1.0:1788940728.994896:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940728.994945:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940728.994952:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d001378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944909568:0@lo:400:kworker.0 00000100:00100000:1.0:1788940728.994979:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940728.995028:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944909952:0@lo:400:kworker.0 00000100:00100000:1.0:1788940728.995051:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940728.995088:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940728.995093:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944910080:0@lo:400:kworker.0 00000100:00100000:1.0:1788940728.995115:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940728.995162:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944910464:0@lo:400:kworker.0 00000100:00100000:1.0:1788940728.995183:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940728.995219:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940728.995225:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944910592:0@lo:400:kworker.0 00000100:00100000:1.0:1788940728.995246:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940728.995296:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944909440 00000100:00100000:1.0:1788940728.995301:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944909440 00000100:00100000:1.0:1788940728.995336:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944909952 00000100:00100000:1.0:1788940728.995338:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944909952 00000100:00100000:1.0:1788940728.995357:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944910080 00000100:00100000:1.0:1788940728.995359:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944910080 00000100:00100000:1.0:1788940728.995371:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944910464 00000100:00100000:1.0:1788940728.995374:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944910464 00000100:00100000:1.0:1788940728.995388:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944910592 00000100:00100000:1.0:1788940728.995390:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944910592 00000100:00100000:1.0:1788940728.995405:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788940728.995412:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0874a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944909440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940728.995456:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0874a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944909440:12345-0@lo:400:kworker.0 Request processed in 44us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940728.995472:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788940728.995488:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788940728.995494:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944909952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940728.995596:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944909952:12345-0@lo:400:kworker.0 Request processed in 102us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940728.995602:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788940728.995615:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788940728.995621:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944910080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940728.995649:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944910080:12345-0@lo:400:kworker.0 Request processed in 28us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940728.995654:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788940728.995666:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788940728.995671:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944910464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940728.995697:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944910464:12345-0@lo:400:kworker.0 Request processed in 26us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940728.995702:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788940728.995713:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788940728.995719:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944910592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940728.995743:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944910592:12345-0@lo:400:kworker.0 Request processed in 25us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940728.995749:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00010000:00080000:1.0:1788940728.995780:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07fd9180 x1875839944910592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940728.995792:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944910592:0@lo:400:kworker.0 00000100:00100000:1.0:1788940728.995812:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944910464:0@lo:400:kworker.0 00010000:00080000:1.0:1788940728.995821:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d0359d5880 x1875839944910080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940728.995829:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944910080:0@lo:400:kworker.0 00000100:00100000:1.0:1788940728.995838:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944909952:0@lo:400:kworker.0 00000100:00100000:1.0:1788940728.995846:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944909440:0@lo:400:kworker.0 00000100:00100000:2.0:1788940728.996356:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944909568 00000100:00100000:2.0:1788940728.996364:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944909568 00000100:00100000:2.0:1788940728.996402:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788940728.996410:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944909568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940728.996468:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944909568:12345-0@lo:400:kworker.0 Request processed in 58us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940728.996475:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788940728.996589:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944909312:0@lo:400:kworker.0 00000100:00100000:2.0:1788940728.996623:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940728.996649:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d001379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944909824:0@lo:400:kworker.0 00000100:00100000:2.0:1788940728.996672:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940728.996690:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944910336:0@lo:400:kworker.0 00000100:00100000:2.0:1788940728.996712:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940728.996733:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788940728.996738:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944909696:0@lo:400:kworker.0 00000100:00100000:2.0:1788940728.996759:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940728.996774:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944910208:0@lo:400:kworker.0 00000100:00100000:2.0:1788940728.996790:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940728.996803:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944910720:0@lo:400:kworker.0 00000100:00100000:2.0:1788940728.996821:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940728.996845:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944909824 00000100:00100000:2.0:1788940728.996860:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944909824 00000100:00100000:2.0:1788940728.996886:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788940728.996892:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944909824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940728.996926:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944909824:12345-0@lo:400:kworker.0 Request processed in 35us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940728.996931:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788940728.996948:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944910336 00000100:00100000:2.0:1788940728.996951:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944910336 00000100:00100000:2.0:1788940728.997000:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944910208 00000100:00100000:2.0:1788940728.997004:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944910208 00000100:00100000:2.0:1788940728.997015:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944910720 00000100:00100000:2.0:1788940728.997018:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944910720 00000100:00100000:2.0:1788940728.997032:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788940728.997038:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1875839944910336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940728.997067:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1875839944910336:12345-0@lo:400:kworker.0 Request processed in 30us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940728.997073:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788940728.997083:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788940728.997088:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944910208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940728.997113:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944910208:12345-0@lo:400:kworker.0 Request processed in 25us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940728.997118:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788940728.997128:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788940728.997133:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944910720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940728.997156:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944910720:12345-0@lo:400:kworker.0 Request processed in 23us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940728.997161:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1788940728.997186:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940728.997189:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940728.997192:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940728.997195:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940728.997220:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944910208:0@lo:400:kworker.0 00000100:00100000:2.0:1788940728.997229:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944910720:0@lo:400:kworker.0 00000100:00100000:2.0:1788940728.997236:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d001379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944909824:0@lo:400:kworker.0 00000100:00100000:2.0:1788940728.997274:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944910336:0@lo:400:kworker.0 00000100:00100000:2.0:1788940728.997306:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d001378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944909568:0@lo:400:kworker.0 00000100:00100000:2.0:1788940728.997323:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944909696 00000100:00100000:2.0:1788940728.997325:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944909696 00000100:00100000:2.0:1788940728.997341:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788940728.997346:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944909696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940728.997375:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944909696:12345-0@lo:400:kworker.0 Request processed in 29us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940728.997380:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788940728.997399:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944909696:0@lo:400:kworker.0 00000100:00100000:0.0:1788940728.997483:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944909312 00000100:00100000:0.0:1788940728.997487:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944909312 00000100:00100000:0.0:1788940728.997526:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1788940728.997533:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944909312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940728.997568:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944909312:12345-0@lo:400:kworker.0 Request processed in 36us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940728.997574:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1788940728.997767:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944909312:0@lo:400:kworker.0 00000100:00100000:0.0:1788940728.999496:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944910848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940728.999632:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940728.999750:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944910848 00000100:00100000:1.0:1788940728.999759:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944910848 00000100:00100000:1.0:1788940728.999814:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788940728.999824:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944910848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788940728.999846:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940728.999919:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944910848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940728.999927:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788940729.000669:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944910848:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1788940729.000783:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1788940729.000807:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91d0359e2c00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788940729.000812:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91d02005ab00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91d0359e2d80 00000020:00080000:1.0:1788940729.000815:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91d02005af00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91d00388ee00 00000020:00080000:1.0:1788940729.000835:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1788940729.000858:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788940729.000929:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1788940729.003293:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddaa1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940729.003313:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddaa1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940729.003320:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddaa1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940729.003326:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940729.003331:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddaa1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940729.003361:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddaa1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940729.003382:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91d0421d1d00) 00010000:00010000:0.0:1788940729.003385:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940729.003392:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddaa1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940729.003399:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddaa1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940729.502342:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1788940729.502362:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:2.0:1788940729.631103:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940730.651568:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940730.961621:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940730.962053:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921757696 00000100:00100000:2.0:1788940730.962065:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921757696 00000100:00100000:2.0:1788940730.962185:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 147 00000100:00100000:2.0:1788940730.962197:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+13:11131:x1875839921757696:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788940730.962332:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+13:11131:x1875839921757696:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 Request processed in 137us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940730.962340:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 147 00000100:00080000:0.0:1788940730.965526:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940730.969207:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940730.969288:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921757824 00000100:00100000:3.0:1788940730.969298:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921757824 00000100:00080000:1.0:1788940730.969345:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788940730.969364:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 148 00000100:00100000:3.0:1788940730.969375:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:11131:x1875839921757824:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788940730.969506:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:11131:x1875839921757824:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 Request processed in 132us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940730.969515:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 148 00000100:00100000:3.0:1788940730.975892:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940730.976079:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921758080 00000100:00100000:2.0:1788940730.976090:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921758080 00000100:00100000:2.0:1788940730.976154:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 35 00000100:00100000:2.0:1788940730.976165:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+13:11131:x1875839921758080:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788940730.976445:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+14:11131:x1875839921758080:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 281us (562us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788940730.976470:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 35 00000100:00100000:2.0:1788940731.327713:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940731.327824:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921758208 00000100:00100000:3.0:1788940731.327862:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921758208 00000100:00100000:3.0:1788940731.327940:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 149 00000100:00100000:3.0:1788940731.327951:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:11937:x1875839921758208:12345-192.168.202.25@tcp:101:lsof.0 00010000:00010000:3.0:1788940731.327971:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940731.327992:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7419 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940731.328060:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940731.328074:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940731.328087:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940731.328132:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788940731.328136:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940731.328175:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940731.328211:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7419 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940731.328248:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7419 expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940731.328306:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65000) 00010000:00010000:3.0:1788940731.328310:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940731.328313:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937a00, rc 0) 00000100:00100000:3.0:1788940731.328387:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:11937:x1875839921758208:12345-192.168.202.25@tcp:101:lsof.0 Request processed in 438us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940731.328394:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 149 00000100:00080000:1.0:1788940731.328669:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940731.549895:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940731.549917:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944910976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940731.549987:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940731.550327:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944910976 00000100:00100000:2.0:1788940731.550336:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944910976 00000100:00100000:2.0:1788940731.550390:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788940731.550400:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944910976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940731.550432:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788940731.550483:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944910976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940731.550489:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788940731.550656:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944910976:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788940731.677750:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940731.686044:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940731.686101:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940731.686138:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940731.686182:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940731.686221:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921758592 00000100:00100000:3.0:1788940731.686235:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921758592 00000100:00100000:3.0:1788940731.686343:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921758464 00000100:00100000:3.0:1788940731.686347:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921758464 00000100:00100000:3.0:1788940731.686388:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 138 00000100:00100000:3.0:1788940731.686528:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921758592:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940731.686625:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921758592:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 227us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940731.686633:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 138 00000100:00100000:3.0:1788940731.686652:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 139 00000100:00100000:3.0:1788940731.686659:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921758464:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940731.686708:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921758464:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 48us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940731.686715:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 139 00000100:00100000:3.0:1788940731.686738:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921758720 00000100:00100000:3.0:1788940731.686742:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921758720 00000100:00100000:3.0:1788940731.686776:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 366 00000100:00100000:3.0:1788940731.686783:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921758720:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940731.686813:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921758720:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 30us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940731.686819:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 366 00000100:00100000:1.0:1788940731.687169:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921758336 00000100:00100000:1.0:1788940731.687177:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921758336 00000100:00100000:1.0:1788940731.687215:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 399 00000100:00100000:1.0:1788940731.687224:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921758336:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940731.687277:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921758336:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 33us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940731.687284:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 399 00000100:00080000:1.0:1788940731.687322:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940731.687328:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940731.687330:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940732.065009:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944911104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940732.065109:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940732.067531:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944911104 00000100:00100000:1.0:1788940732.067554:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944911104 00000100:00100000:1.0:1788940732.067679:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788940732.067695:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944911104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788940732.067742:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788940732.067863:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944911104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 173us (2753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940732.067872:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788940732.068204:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944911104:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788940732.068243:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940732.071045:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944911232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940732.071142:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940732.071274:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944911232 00000100:00100000:0.0:1788940732.071295:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944911232 00000100:00100000:0.0:1788940732.071377:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788940732.071386:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944911232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940732.071414:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788940732.071755:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1788940732.071762:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91cf08c98a80, transno 4294967311 00000004:00080000:2.0:1788940732.071777:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1788940732.071850:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944911232:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788940732.072023:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940732.072420:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944911232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1032us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940732.072449:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00010000:00010000:2.0:1788940732.702595:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940733.083696:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944911360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940733.083823:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940733.084043:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944911360 00000100:00100000:2.0:1788940733.084054:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944911360 00000100:00100000:2.0:1788940733.084124:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788940733.084136:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944911360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940733.084189:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940733.084281:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944911360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940733.084312:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788940733.084385:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944911360:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788940733.726572:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940734.107949:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944911488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940734.108071:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788940734.110182:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788940734.110307:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940734.110331:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944911616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940734.110422:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940734.110453:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944911488 00000100:00100000:2.0:1788940734.110463:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944911488 00000100:00100000:2.0:1788940734.110523:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944911616 00000100:00100000:2.0:1788940734.110526:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944911616 00000100:00100000:2.0:1788940734.110544:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788940734.110554:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944911488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788940734.110591:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940734.110648:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944911488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (2577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940734.110656:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788940734.110672:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788940734.110678:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944911616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940734.110689:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940734.110710:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944911616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940734.110716:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:2.0:1788940734.110734:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940734.110822:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944911616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940734.110841:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944911488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940734.117842:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944912128:0@lo:400:kworker.0 00000100:00100000:3.0:1788940734.117957:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940734.118026:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00d26e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944912640:0@lo:400:kworker.0 00000100:00100000:3.0:1788940734.118058:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940734.118089:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788940734.118095:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944912000:0@lo:400:kworker.0 00000100:00100000:3.0:1788940734.118123:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940734.118139:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00d26c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944912512:0@lo:400:kworker.0 00000100:00100000:3.0:1788940734.118163:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940734.118181:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf084de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944913024:0@lo:400:kworker.0 00000100:00100000:3.0:1788940734.118204:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940734.118237:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944912128 00000100:00100000:3.0:1788940734.118247:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944912128 00000100:00100000:3.0:1788940734.118367:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944912512 00000100:00100000:3.0:1788940734.118371:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944912512 00000100:00100000:3.0:1788940734.118423:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944913024 00000100:00100000:3.0:1788940734.118427:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944913024 00000100:00100000:3.0:1788940734.118448:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788940734.118458:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944912128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940734.118524:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944912128:12345-0@lo:400:kworker.0 Request processed in 67us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940734.118532:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788940734.118551:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788940734.118557:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944912512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940734.118586:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944912512:12345-0@lo:400:kworker.0 Request processed in 29us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940734.118592:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788940734.118602:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788940734.118607:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944913024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940734.118629:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944913024:12345-0@lo:400:kworker.0 Request processed in 23us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940734.118635:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788940734.118677:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944912640 00000100:00100000:3.0:1788940734.118682:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944912640 00000100:00100000:3.0:1788940734.118710:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788940734.118717:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944912640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940734.118749:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944912640:12345-0@lo:400:kworker.0 Request processed in 33us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940734.118755:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1788940734.118779:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940734.118784:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788940734.118830:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d00d26c000 x1875839944912512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940734.118855:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00d26c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944912512:0@lo:400:kworker.0 00010000:00080000:3.0:1788940734.118870:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf084de680 x1875839944913024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940734.118878:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf084de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944913024:0@lo:400:kworker.0 00000100:00100000:3.0:1788940734.118890:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944912128:0@lo:400:kworker.0 00000100:00100000:3.0:1788940734.118900:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00d26e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944912640:0@lo:400:kworker.0 00000100:00100000:0.0:1788940734.118989:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944911872:0@lo:400:kworker.0 00000100:00100000:0.0:1788940734.119031:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940734.119071:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944912384:0@lo:400:kworker.0 00000100:00100000:0.0:1788940734.119097:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940734.119117:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf084dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944912896:0@lo:400:kworker.0 00000100:00100000:0.0:1788940734.119141:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940734.119165:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788940734.119172:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944911744:0@lo:400:kworker.0 00000100:00100000:0.0:1788940734.119206:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940734.119210:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944912000 00000100:00100000:1.0:1788940734.119217:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944912000 00000100:00100000:0.0:1788940734.119234:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944912256:0@lo:400:kworker.0 00000100:00100000:1.0:1788940734.119284:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788940734.119294:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940734.119298:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944912000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940734.119319:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf084dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944912768:0@lo:400:kworker.0 00000100:00100000:1.0:1788940734.119348:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944912000:12345-0@lo:400:kworker.0 Request processed in 55us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940734.119355:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940734.119371:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788940734.119392:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944912256 00000100:00100000:1.0:1788940734.119396:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944912256 00000100:00100000:0.0:1788940734.119406:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944911744 00000100:00100000:0.0:1788940734.119412:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944911744 00000100:00100000:1.0:1788940734.119416:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788940734.119425:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944912256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940734.119456:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1788940734.119469:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944912256:12345-0@lo:400:kworker.0 Request processed in 43us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940734.119470:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944911744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940734.119483:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788940734.119529:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944911744:12345-0@lo:400:kworker.0 Request processed in 64us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940734.119534:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944911872 00000100:00100000:0.0:1788940734.119539:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1788940734.119541:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944911872 00000100:00100000:1.0:1788940734.119571:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944912384 00000100:00100000:1.0:1788940734.119575:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944912384 00000100:00100000:0.0:1788940734.119579:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944912768 00000100:00100000:0.0:1788940734.119585:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944912768 00000100:00100000:3.0:1788940734.119641:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944912896 00000100:00100000:3.0:1788940734.119645:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944912896 00000100:00100000:1.0:1788940734.119696:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788940734.119709:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944911872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940734.119709:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788940734.119723:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944912768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940734.119752:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944911872:12345-0@lo:400:kworker.0 Request processed in 48us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940734.119760:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788940734.119774:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944912768:12345-0@lo:400:kworker.0 Request processed in 54us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940734.119779:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788940734.119788:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788940734.119793:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944912384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940734.119840:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944912384:12345-0@lo:400:kworker.0 Request processed in 51us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940734.119843:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944911744:0@lo:400:kworker.0 00000100:00100000:1.0:1788940734.119854:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788940734.119862:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944912256:0@lo:400:kworker.0 00000100:00100000:0.0:1788940734.119873:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf084dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944912768:0@lo:400:kworker.0 00000100:00100000:0.0:1788940734.119883:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944911872:0@lo:400:kworker.0 00000100:00100000:0.0:1788940734.119894:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944912384:0@lo:400:kworker.0 00000100:00080000:1.0:1788940734.119904:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940734.119910:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940734.120558:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944912000:0@lo:400:kworker.0 00000100:00100000:3.0:1788940734.123931:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788940734.123951:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944912896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940734.125956:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944912896:12345-0@lo:400:kworker.0 Request processed in 1997us (6799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940734.126146:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788940734.137540:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf084dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944912896:0@lo:400:kworker.0 00000001:00080000:1.0:1788940734.622881:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1788940734.622895:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788940734.623298:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788940734.623314:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788940734.747518:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940734.875458:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940734.875469:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940734.875556:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:0.0:1788940734.875563:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788940735.780865:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788940736.127637:0:14516:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 03:58:55 (1788940735) 00000100:00100000:3.0:1788940736.668475:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944913152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940736.668547:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940736.668669:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944913152 00000100:00100000:1.0:1788940736.668678:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944913152 00000100:00100000:1.0:1788940736.668723:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788940736.668743:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944913152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788940736.668775:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788940736.668836:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944913152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940736.668841:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788940736.668934:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944913152:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788940736.798446:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940736.806525:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940736.806570:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940736.806606:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940736.806640:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940736.806664:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940736.806672:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921758848 00000100:00100000:3.0:1788940736.806682:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940736.806682:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921758848 00000100:00100000:3.0:1788940736.806726:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940736.806728:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 401 00000100:00100000:0.0:1788940736.806738:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921758848:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940736.806748:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921759104 00000100:00100000:3.0:1788940736.806751:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921759104 00000100:00100000:3.0:1788940736.806816:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921759616 00000100:00100000:3.0:1788940736.806819:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921759616 00000100:00100000:0.0:1788940736.806825:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2407:x1875839921758848:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 88us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940736.806832:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921758976 00000100:00100000:0.0:1788940736.806832:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 401 00000100:00100000:3.0:1788940736.806834:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921758976 00000100:00100000:3.0:1788940736.806845:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921759488 00000100:00100000:3.0:1788940736.806847:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921759488 00000100:00100000:3.0:1788940736.806860:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 373 00000100:00100000:0.0:1788940736.806864:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921759360 00000100:00100000:3.0:1788940736.806866:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921759104:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940736.806867:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921759360 00000100:00100000:0.0:1788940736.806889:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921759232 00000100:00100000:0.0:1788940736.806892:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921759232 00000100:00100000:3.0:1788940736.806896:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921759104:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 31us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940736.806903:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 373 00000100:00100000:3.0:1788940736.806915:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 374 00000100:00100000:3.0:1788940736.806921:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921759616:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940736.806922:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 142 00000100:00100000:0.0:1788940736.806927:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921759360:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940736.806943:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2407:x1875839921759616:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 22us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940736.806947:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2407:x1875839921759360:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 19us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940736.806949:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 374 00000100:00100000:0.0:1788940736.806952:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 142 00000100:00100000:3.0:1788940736.806960:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 375 00000100:00100000:0.0:1788940736.806961:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 143 00000100:00100000:3.0:1788940736.806966:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+13:2407:x1875839921758976:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940736.806966:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921759232:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940736.806986:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921759232:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 20us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940736.806989:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+13:2407:x1875839921758976:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 24us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940736.806992:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 143 00000100:00100000:3.0:1788940736.806994:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 375 00000100:00100000:3.0:1788940736.807003:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 376 00000100:00100000:3.0:1788940736.807009:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2407:x1875839921759488:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940736.807038:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2407:x1875839921759488:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 29us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940736.807043:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 376 00000100:00080000:1.0:1788940736.807346:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940736.807351:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940736.807354:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940736.807355:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788940737.179488:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944913280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940737.179562:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940737.183984:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944913280 00000100:00100000:2.0:1788940737.184003:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944913280 00000100:00100000:2.0:1788940737.184121:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788940737.184144:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944913280:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940737.184175:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf084dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944913408:0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940737.184195:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00080000:0.0:1788940737.184302:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940737.190861:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940737.192036:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944913408 00000100:00100000:1.0:1788940737.192047:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944913408 00000100:00100000:1.0:1788940737.192123:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788940737.192134:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944913408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940737.192160:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788940737.192222:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944913408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940737.192229:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:0.0:1788940737.192314:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940737.192510:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf084dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944913408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940737.195479:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944913280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 11329us (15904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940737.195494:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788940737.196140:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944913280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940737.725982:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940737.726483:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921759872 00000100:00100000:0.0:1788940737.726507:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921759872 00000100:00100000:0.0:1788940737.726576:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 150 00000100:00100000:0.0:1788940737.726587:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf084dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+13:12205:x1875839921759872:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940737.726608:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940737.726628:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddb3b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7420 expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.726703:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddb42 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.726718:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddb42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.726731:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddb42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.726744:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddb49 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.726750:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddb49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.726756:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddb49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.726858:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08baddb50 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.726866:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08baddb50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.726874:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08baddb50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940737.726890:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788940737.726971:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddb42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.726979:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddb42 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.726985:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddb42 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.726990:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940737.726995:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddb42 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.727002:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddb42 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.727014:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91d0421d1c00) 00010000:00010000:0.0:1788940737.727017:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940737.727022:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddb42 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.727028:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddb42 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.727040:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddb49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.727046:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddb49 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.727060:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddb49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.727064:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940737.727067:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddb49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.727072:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddb49 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.727079:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91d0421d1e00) 00010000:00010000:0.0:1788940737.727081:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940737.727084:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddb49 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.727089:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddb49 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.731073:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddb3b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7420 expref: 16 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.731102:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08baddb50 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7420 expref: 15 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.731111:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91cf07e67400) 00010000:00010000:0.0:1788940737.731114:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940737.731117:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d000031e00, rc 0) 00000100:00100000:0.0:1788940737.731221:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf084dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+15:12205:x1875839921759872:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 4634us (5247us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788940737.731247:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 150 00000100:00100000:0.0:1788940737.740869:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940737.740972:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940737.741106:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921760128 00000100:00100000:1.0:1788940737.741116:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921760128 00000100:00100000:1.0:1788940737.741205:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00100000:1.0:1788940737.741215:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+15:2404:x1875839921760128:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940737.741230:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940737.741302:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08baddb50 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7420 expref: 15 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940737.741323:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91cf07e67400) 00010000:00010000:1.0:1788940737.741328:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940737.741350:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921760000 00000100:00100000:3.0:1788940737.741354:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921760000 00000100:00100000:3.0:1788940737.741386:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 151 00000100:00100000:1.0:1788940737.741391:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+15:2404:x1875839921760128:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 178us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940737.741392:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+15:12205:x1875839921760000:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788940737.741398:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00100000:3.0:1788940737.741459:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+14:12205:x1875839921760000:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 Request processed in 67us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940737.741466:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 151 00000100:00100000:3.0:1788940737.745446:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940737.745581:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921760256 00000100:00100000:1.0:1788940737.745592:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921760256 00000100:00100000:1.0:1788940737.745652:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 152 00000100:00100000:1.0:1788940737.745662:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:12205:x1875839921760256:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788940737.745761:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:12205:x1875839921760256:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 Request processed in 100us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940737.745780:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 152 00010000:00010000:3.0:1788940737.820480:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940737.947432:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940737.947442:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940737.947459:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:0.0:1788940737.947467:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788940738.205315:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940738.205357:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944913536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788940738.205475:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940738.205600:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944913536 00000100:00100000:3.0:1788940738.205613:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944913536 00000100:00100000:3.0:1788940738.205690:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788940738.205701:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944913536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788940738.205750:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788940738.205819:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944913536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940738.205847:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788940738.205907:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944913536:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788940738.208929:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788940738.845349:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940739.227647:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944913664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940739.227750:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940739.227857:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944913664 00000100:00100000:2.0:1788940739.227866:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944913664 00000100:00100000:0.0:1788940739.228841:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944914048:0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.229237:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.229306:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944914560:0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.229335:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.229356:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0854b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944915072:0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.229379:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940739.229603:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788940739.229619:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944913664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940739.229662:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940739.229718:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944913664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940739.229726:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788940739.229795:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944914176:0@lo:400:kworker.0 00000100:00100000:2.0:1788940739.229827:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940739.229850:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944914688:0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.231023:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944913792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940739.231557:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.231612:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944914304:0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.231660:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944913920:0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.231696:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.231721:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944914432:0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.231745:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.231778:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944914944:0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.231804:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940739.231806:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944914048 00000100:00100000:3.0:1788940739.231818:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944914048 00000100:00100000:0.0:1788940739.231845:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944914560 00000100:00100000:0.0:1788940739.231858:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944914560 00000100:00100000:3.0:1788940739.231871:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944915072 00000100:00100000:3.0:1788940739.231874:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944915072 00000100:00100000:3.0:1788940739.231899:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788940739.231909:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944914048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940739.231974:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940739.231975:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944914048:12345-0@lo:400:kworker.0 Request processed in 68us (2740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940739.231983:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788940739.231998:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944914688 00000100:00100000:2.0:1788940739.232001:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0854a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944915200:0@lo:400:kworker.0 00000100:00100000:3.0:1788940739.232002:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944914688 00000100:00100000:3.0:1788940739.232019:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788940739.232024:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944915072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940739.232026:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940739.233573:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944913664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940739.233639:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944914176 00000100:00100000:2.0:1788940739.233660:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944914176 00000100:00100000:2.0:1788940739.233711:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944914432 00000100:00100000:2.0:1788940739.233715:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944914432 00000100:00100000:2.0:1788940739.233736:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788940739.233744:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944914176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.234728:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944915200 00000100:00100000:0.0:1788940739.234738:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944915200 00000100:00100000:0.0:1788940739.234786:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788940739.234797:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944914688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940739.238654:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944915072:12345-0@lo:400:kworker.0 Request processed in 6615us (9258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940739.238676:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788940739.238727:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788940739.238745:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944914560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940739.238821:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944914560:12345-0@lo:400:kworker.0 Request processed in 86us (9486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940739.238828:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788940739.238846:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1788940739.238854:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944915200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940739.238928:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944915200:12345-0@lo:400:kworker.0 Request processed in 75us (6900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940739.238935:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1788940739.238983:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788940739.238993:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944914432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940739.239050:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944914432:12345-0@lo:400:kworker.0 Request processed in 59us (7303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940739.239055:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00010000:00080000:3.0:1788940739.239291:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf0854a300 x1875839944915200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940739.239308:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0854a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944915200:0@lo:400:kworker.0 00000100:00100000:2.0:1788940739.239858:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944914176:12345-0@lo:400:kworker.0 Request processed in 6111us (10027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940739.239868:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788940739.240120:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944913920 00000100:00100000:1.0:1788940739.240130:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944913920 00000100:00100000:1.0:1788940739.240176:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1788940739.240183:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944913920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940739.240226:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944913920:12345-0@lo:400:kworker.0 Request processed in 44us (8530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940739.240232:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1788940739.240289:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944913792 00000100:00100000:1.0:1788940739.240294:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944913792 00000100:00100000:3.0:1788940739.240437:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944914176:0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.241367:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944913920:0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.241384:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944914432:0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.241553:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944914944 00000100:00100000:0.0:1788940739.241560:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944914944 00000100:00100000:0.0:1788940739.241619:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788940739.241629:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944914944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.241699:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944914944:12345-0@lo:400:kworker.0 Request processed in 72us (9894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940739.241706:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788940739.241743:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.241798:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944914816:0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.241840:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.241860:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944915328:0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.244335:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.244512:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944914816 00000100:00100000:0.0:1788940739.244524:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944914816 00000100:00100000:0.0:1788940739.244584:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944915328 00000100:00100000:0.0:1788940739.244587:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944915328 00000100:00100000:1.0:1788940739.244598:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788940739.244606:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788940739.244613:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875839944913792:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940739.244613:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944914816:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1788940739.244652:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940739.244689:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875839944913792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (13135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940739.244689:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944914816:12345-0@lo:400:kworker.0 Request processed in 77us (2847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940739.244696:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788940739.244701:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788940739.244716:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788940739.244721:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944915328:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788940739.244727:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940739.244734:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940739.244737:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940739.244740:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940739.244750:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944915328:12345-0@lo:400:kworker.0 Request processed in 28us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940739.244769:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944914304 00000100:00100000:0.0:1788940739.244769:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788940739.244773:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944914304 00000100:00100000:1.0:1788940739.244801:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788940739.244807:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0042b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944914304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.244831:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944913792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788940739.244841:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0042b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944914304:12345-0@lo:400:kworker.0 Request processed in 36us (3099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940739.244844:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944914304:0@lo:400:kworker.0 00000100:00100000:1.0:1788940739.244848:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1788940739.244856:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944914816:0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.244864:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944915328:0@lo:400:kworker.0 00000100:00100000:1.0:1788940739.244902:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944914048:0@lo:400:kworker.0 00000100:00100000:0.0:1788940739.244908:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944914944:0@lo:400:kworker.0 00000100:00100000:1.0:1788940739.244918:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944914560:0@lo:400:kworker.0 00000100:00100000:1.0:1788940739.244930:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0854b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944915072:0@lo:400:kworker.0 00000100:00100000:1.0:1788940739.244984:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944914688:12345-0@lo:400:kworker.0 Request processed in 10190us (15109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940739.244992:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00010000:00080000:0.0:1788940739.246418:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d03588c000 x1875839944914688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940739.246592:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944914688:0@lo:400:kworker.0 00010000:00010000:1.0:1788940739.869235:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940740.019220:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940740.022902:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921760384 00000100:00100000:1.0:1788940740.022926:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921760384 00000100:00100000:1.0:1788940740.023160:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 153 00000100:00100000:1.0:1788940740.023176:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0854a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+14:12247:x1875839921760384:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788940740.023220:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940740.023249:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08baddb5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7427 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023364:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddb65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023384:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddb65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023400:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddb65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023418:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddb6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023425:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddb6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023433:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddb6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023492:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddb65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023501:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddb65 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023510:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddb65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023517:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940740.023528:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddb65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023538:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddb65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023553:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65000) 00000100:00080000:2.0:1788940740.023556:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788940740.023557:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940740.023564:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddb65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023571:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddb65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023586:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddb6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023593:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddb6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023599:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddb6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023604:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940740.023608:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddb6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023613:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddb6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023621:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91cf06dfa300) 00010000:00010000:1.0:1788940740.023623:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940740.023633:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddb6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023639:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddb6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023682:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08baddb5e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7427 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023693:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65000) 00010000:00010000:1.0:1788940740.023696:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940740.023700:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08baddb5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7427 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.023712:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602000, rc 0) 00000100:00100000:1.0:1788940740.023837:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0854a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+14:12247:x1875839921760384:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 665us (4633us total) trans 0 rc 301/301 00000100:00100000:1.0:1788940740.023845:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 153 00000100:00100000:0.0:1788940740.036446:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940740.036509:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921760640 00000100:00100000:3.0:1788940740.036525:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921760640 00000100:00100000:3.0:1788940740.036605:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 154 00000100:00100000:3.0:1788940740.036617:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+14:12247:x1875839921760640:12345-192.168.202.25@tcp:36:lfs.0 00010000:00010000:3.0:1788940740.036693:0:9713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940740.036728:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08badd4b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc724b expref: 14 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.036761:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65000) 00010000:00010000:3.0:1788940740.036767:0:9713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940740.036858:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb73 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.036886:0:9713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7419 expref: 5 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.036897:0:9713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb73 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.036947:0:9713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7419 expref: 5 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.036965:0:9713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7419 expref: 5 pid: 6520 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940740.036982:0:9713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0854b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9713:1875839944915456:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788940740.037109:0:9713:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06eb3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940740.044707:0:9713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0854b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9713:1875839944915456:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940740.044766:0:9713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb73 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940740.050127:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940740.050521:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921760768 00000100:00100000:0.0:1788940740.050537:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921760768 00010000:00010000:0.0:1788940740.050613:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7419 expref: 6 pid: 6520 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940740.050670:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 80 00000100:00100000:0.0:1788940740.050683:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2404:x1875839921760768:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940740.050722:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940740.050731:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7419 expref: 6 pid: 6520 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.050778:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7419 expref: 6 pid: 6520 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.050809:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddb34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7419 expref: 6 pid: 6520 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.050823:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65000) 00010000:00010000:0.0:1788940740.050829:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb73 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.050841:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb73 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.050851:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb73 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.050883:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940740.050958:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921760768:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 277us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940740.050965:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 80 00000100:00080000:1.0:1788940740.051209:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788940740.051724:0:9713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb73 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.051736:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb73 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.051779:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddb7a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.051792:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddb7a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.051810:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddb7a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.052576:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddb81 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.052591:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddb81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.052599:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddb81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940740.052617:0:9713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6cef2b9 reply state 00000000948fef67 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddb81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.052629:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddb81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.052636:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d00c3afe00) 00010000:00010000:3.0:1788940740.052639:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788940740.052644:0:9713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788940740.052652:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788940740.052661:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb73 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.052667:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb73 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.052674:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb73 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.052680:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940740.052693:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb73 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.052703:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb73 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.052714:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65000) 00010000:00010000:3.0:1788940740.052717:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940740.052721:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb73 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.052729:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb73 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940740.052768:0:9713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6cef2b9 reply state 00000000948fef67 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddb7a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.052777:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddb7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.052783:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91d00c3af200) 00010000:00010000:3.0:1788940740.052785:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788940740.052787:0:9713:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788940740.052900:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+15:12247:x1875839921760640:12345-192.168.202.25@tcp:36:lfs.0 Request processed in 16280us (16465us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788940740.052909:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 154 00000001:00080000:3.0:1788940740.062209:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00010000:00010000:1.0:1788940740.063864:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddb7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.063887:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddb7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.063895:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddb7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.063902:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940740.063916:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddb7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.063926:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddb7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.063951:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91d00c3af200) 00010000:00010000:1.0:1788940740.063954:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940740.063960:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddb7a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.063967:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddb7a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.063992:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddb81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.063998:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddb81 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.064004:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddb81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.064010:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940740.064013:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddb81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.064018:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddb81 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.064026:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d00c3afe00) 00010000:00010000:1.0:1788940740.064029:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940740.064038:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddb81 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.064044:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddb81 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940740.228910:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940740.228996:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921760896 00000100:00100000:3.0:1788940740.229012:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921760896 00000100:00100000:3.0:1788940740.229096:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 155 00000100:00100000:3.0:1788940740.229107:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+12:12255:x1875839921760896:12345-192.168.202.25@tcp:101:lctl.0 00010000:00010000:3.0:1788940740.229170:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940740.229200:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc742e expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.229429:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08baddb8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.229448:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08baddb8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.229464:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08baddb8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940740.229524:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788940740.229528:0:8517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940740.229553:0:8517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08baddb8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.229581:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddb88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc742e expref: 14 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.229602:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08baddb8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc742e expref: 13 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.229613:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65400) 00010000:00010000:3.0:1788940740.229616:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940740.229621:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936400, rc 0) 00000100:00100000:3.0:1788940740.229694:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+13:12255:x1875839921760896:12345-192.168.202.25@tcp:101:lctl.0 Request processed in 588us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940740.229701:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 155 00000100:00100000:0.0:1788940740.304887:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940740.307624:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921761024 00000100:00100000:1.0:1788940740.307647:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921761024 00000100:00100000:2.0:1788940740.307916:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 156 00000100:00100000:2.0:1788940740.307931:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+13:12261:x1875839921761024:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1788940740.307967:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940740.307997:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08baddb96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7435 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308094:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08baddb9d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308115:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08baddb9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308131:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08baddb9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308148:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddba4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308156:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308162:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308351:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08baddbab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308361:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08baddbab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308368:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08baddbab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940740.308418:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788940740.308424:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788940740.308452:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08baddbab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308468:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08baddb9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308475:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08baddb9d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308483:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08baddb9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308490:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940740.308495:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08baddb9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308504:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08baddb9d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308517:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65400) 00010000:00010000:2.0:1788940740.308528:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940740.308535:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08baddb9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308542:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08baddb9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308560:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308567:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddba4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308573:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddba4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308579:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940740.308581:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddba4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308588:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddba4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308596:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91d03ed37900) 00010000:00010000:2.0:1788940740.308599:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940740.308601:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddba4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308606:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddba4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308647:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6200/0x9c34acc08baddb96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7435 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308674:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08baddbab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7435 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.308682:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:2.0:1788940740.308684:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788940740.308687:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7a00, rc 0) 00000100:00100000:2.0:1788940740.308947:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+14:12261:x1875839921761024:12345-192.168.202.25@tcp:101:bash.0 Request processed in 1018us (4076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940740.308956:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 156 00000100:00100000:0.0:1788940740.312836:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940740.320054:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921761280 00000100:00100000:2.0:1788940740.320078:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921761280 00000100:00100000:2.0:1788940740.320197:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 157 00000100:00100000:2.0:1788940740.320210:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+14:12261:x1875839921761280:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1788940740.320239:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940740.320288:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08baddbb2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc743c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.320962:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddbb9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.320984:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddbb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.321000:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddbb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.326144:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08baddbc0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.326210:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08baddbc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.326226:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08baddbc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788940740.335097:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788940740.335362:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddbc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.335382:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.335394:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.335434:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddbb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.335443:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddbb9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.335452:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddbb9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.335460:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940740.338005:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddbb9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.338031:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddbb9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.338075:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:2.0:1788940740.338078:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940740.338084:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddbb9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.338092:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08baddbb9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940740.338112:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000243bc50c reply state 00000000364a59b7 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08baddbc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.338125:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08baddbc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.338133:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91d03ed37300) 00010000:00010000:2.0:1788940740.338135:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788940740.338139:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788940740.338191:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08baddbb2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc743c expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.338206:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddbc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc743c expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.338214:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91d03ed37b00) 00010000:00010000:2.0:1788940740.338216:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940740.338218:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6800, rc 0) 00000100:00100000:2.0:1788940740.338319:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+17:12261:x1875839921761280:12345-192.168.202.25@tcp:101:bash.0 Request processed in 18109us (25499us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1788940740.338329:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 157 00000100:00100000:0.0:1788940740.348630:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940740.348878:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921761408 00000100:00100000:1.0:1788940740.348892:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921761408 00000100:00100000:1.0:1788940740.348998:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:1.0:1788940740.349015:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921761408:12345-192.168.202.25@tcp:101:bash.0 00000100:00080000:2.0:1788940740.349019:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788940740.349042:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940740.349071:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddbd5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7443 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940740.349107:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788940740.349136:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=495s v=(0 0) 00010000:00010000:1.0:1788940740.349142:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940740.349154:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddbd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7443 expref: 6 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.349179:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddbd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7443 expref: 6 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.349199:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603a00, rc 0) 00000100:00100000:1.0:1788940740.349458:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+6:2405:x1875839921761408:12345-192.168.202.25@tcp:101:bash.0 Request processed in 447us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940740.350175:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:0.0:1788940740.358422:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940740.358585:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921761536 00000100:00100000:2.0:1788940740.358599:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921761536 00000100:00100000:2.0:1788940740.358684:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:2.0:1788940740.358696:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:12261:x1875839921761536:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1788940740.358722:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940740.358762:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a535b544/0x9c34acc08baddbdc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc744a expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.358810:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddbd5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7443 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.358821:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940740.358826:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940740.358831:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a535b544/0x9c34acc08baddbdc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc744a expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.358877:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddbd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7443 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.358894:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddbd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7443 expref: 7 pid: 8438 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940740.358911:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07f71c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8437:1875839944915584:192.168.202.25@tcp:104: 00000100:00100000:2.0:1788940740.359045:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c7fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940740.362022:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940740.362165:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07f71c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8437:1875839944915584:192.168.202.25@tcp:104: 00010000:00010000:0.0:1788940740.362230:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a535b544/0x9c34acc08baddbdc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc744a expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.362307:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7c00, rc 0) 00000100:00100000:0.0:1788940740.362383:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+7:12261:x1875839921761536:12345-192.168.202.25@tcp:101:bash.0 Request processed in 3689us (3974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940740.362396:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:1.0:1788940740.362507:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921761664 00000100:00100000:1.0:1788940740.362517:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921761664 00010000:00010000:1.0:1788940740.362558:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddbd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7443 expref: 7 pid: 8438 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940740.362597:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 81 00000100:00100000:1.0:1788940740.362609:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+7:2404:x1875839921761664:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940740.362625:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940740.362654:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddbd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7443 expref: 7 pid: 8438 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.362670:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddbd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7443 expref: 7 pid: 8438 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.362699:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddbd5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7443 expref: 7 pid: 8438 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.362717:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940740.362722:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940740.362732:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a535b544/0x9c34acc08baddbdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc744a expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.362753:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a535b544/0x9c34acc08baddbdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc744a expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.362812:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a535b544/0x9c34acc08baddbdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc744a expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940740.362831:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6505:1875839944915712:192.168.202.25@tcp:105: 00000100:00100000:1.0:1788940740.362901:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c309c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940740.366606:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940740.366713:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921761920 00000100:00100000:0.0:1788940740.366726:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921761920 00000100:00100000:0.0:1788940740.366815:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:0.0:1788940740.366827:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+17:12261:x1875839921761920:12345-192.168.202.25@tcp:35:bash.0 00000001:00080000:0.0:1788940740.367151:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967420 00000100:00100000:0.0:1788940740.367563:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+19:12261:x1875839921761920:12345-192.168.202.25@tcp:35:bash.0 Request processed in 736us (969us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788940740.367574:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 36 00000020:00080000:0.0:1788940740.367580:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788940740.368015:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6505:1875839944915712:192.168.202.25@tcp:105: 00010000:00010000:3.0:1788940740.368046:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940740.368077:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921761664:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 5471us (6071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940740.368086:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 81 00000100:00100000:2.0:1788940740.528043:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940740.528318:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921762176 00000100:00100000:3.0:1788940740.528334:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921762176 00000100:00100000:3.0:1788940740.528418:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 158 00000100:00100000:3.0:1788940740.528433:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+19:12272:x1875839921762176:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940740.528481:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940740.528512:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddbe3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7451 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940740.528667:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788940740.528831:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddbe3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7451 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.528850:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65400) 00010000:00010000:3.0:1788940740.528854:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788940740.528861:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddbe3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7451 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.528882:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936e00, rc 0) 00000100:00100000:3.0:1788940740.528992:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+20:12272:x1875839921762176:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 562us (963us total) trans 4294967422 rc 301/301 00000100:00100000:3.0:1788940740.529002:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 158 00000100:00100000:2.0:1788940740.536801:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940740.536921:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921762432 00000100:00100000:0.0:1788940740.536935:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921762432 00000100:00100000:0.0:1788940740.537019:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 37 00000100:00100000:0.0:1788940740.537032:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+20:12272:x1875839921762432:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1788940740.537425:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+21:12272:x1875839921762432:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 393us (641us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1788940740.537436:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 37 00000100:00100000:2.0:1788940740.650966:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940740.652332:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921762560 00000100:00100000:1.0:1788940740.652348:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921762560 00000100:00100000:1.0:1788940740.652584:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 159 00000100:00100000:1.0:1788940740.652599:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+21:12278:x1875839921762560:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788940740.652634:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940740.652664:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddbf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7458 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.652765:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08baddbf8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.652784:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08baddbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.652799:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08baddbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940740.652860:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788940740.652863:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788940740.652890:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08baddbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.652950:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddbf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7458 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.652977:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08baddbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7458 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.652987:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:1.0:1788940740.652990:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940740.652994:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602800, rc 0) 00000100:00100000:1.0:1788940740.657451:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+22:12278:x1875839921762560:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 4830us (6475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940740.657470:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 159 00000100:00100000:2.0:1788940740.666666:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940740.667147:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921762816 00000100:00100000:3.0:1788940740.667181:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921762816 00000100:00100000:3.0:1788940740.667365:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 160 00000100:00100000:3.0:1788940740.667379:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+22:12278:x1875839921762816:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940740.667420:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940740.667449:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddbff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc745f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.667823:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddc06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.667842:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddc06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.667859:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddc06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940740.667874:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788940740.668036:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddbff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc745f expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.668071:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddc06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc745f expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.668081:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91d03ed37b00) 00010000:00010000:3.0:1788940740.668084:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940740.668089:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937c00, rc 0) 00000100:00100000:3.0:1788940740.668188:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+24:12278:x1875839921762816:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 813us (1541us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1788940740.668197:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 160 00000100:00100000:2.0:1788940740.681093:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940740.681144:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940740.681967:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921763072 00000100:00100000:0.0:1788940740.681984:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921763072 00000100:00100000:0.0:1788940740.682079:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 161 00000100:00100000:0.0:1788940740.682114:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+24:12278:x1875839921763072:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1788940740.682152:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940740.682181:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08baddc14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7466 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.682365:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddc1b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.682385:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddc1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.682401:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddc1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940740.682613:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788940740.682765:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08baddc14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7466 expref: 27 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.682790:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddc1b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7466 expref: 26 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.682800:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91d03ed37b00) 00010000:00010000:0.0:1788940740.682804:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788940740.682808:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d000031200, rc 0) 00000100:00100000:0.0:1788940740.682904:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+26:12278:x1875839921763072:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 795us (1826us total) trans 4294967425 rc 0/0 00000100:00100000:0.0:1788940740.682913:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 161 00000100:00100000:1.0:1788940740.683032:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921763200 00000100:00100000:1.0:1788940740.683040:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921763200 00000100:00100000:1.0:1788940740.683112:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:1.0:1788940740.683121:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+26:2406:x1875839921763200:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940740.683133:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940740.683151:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddc06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc745f expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.683162:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91d03ed37b00) 00010000:00010000:1.0:1788940740.683166:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940740.683200:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+25:2406:x1875839921763200:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 81us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940740.683207:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:2.0:1788940740.698101:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940740.698298:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921763328 00000100:00100000:1.0:1788940740.698333:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921763328 00000100:00100000:1.0:1788940740.698418:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:1.0:1788940740.698432:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+6:2407:x1875839921763328:12345-192.168.202.25@tcp:1:lfs.0 00010000:00010000:1.0:1788940740.698503:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddc29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.698531:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a535b544/0x9c34acc08baddbdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc744a expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.698541:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788940740.698546:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788940740.698553:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddc29 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.698599:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a535b544/0x9c34acc08baddbdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc744a expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.698617:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a535b544/0x9c34acc08baddbdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc744a expref: 6 pid: 8437 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940740.698633:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8438:1875839944915840:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940740.698774:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30780 going to sleep for 11 seconds 00000100:00100000:2.0:1788940740.702628:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940740.702783:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921763456 00000100:00100000:3.0:1788940740.702799:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921763456 00002000:00100000:3.0:1788940740.702870:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff91d018b08700 x1875839921763456/t0(0) o4->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:716/0 lens 504/0 e 0 to 0 dl 1788940751 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788940740.702883:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91d018b08700 with x1875839921763456 ext(0->12) 00010000:00010000:3.0:1788940740.702895:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a535b544/0x9c34acc08baddbdc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc744a expref: 7 pid: 8437 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.702914:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a535b544/0x9c34acc08baddbdc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc744a expref: 7 pid: 8437 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940740.702922:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91d018b08700 00000100:00100000:3.0:1788940740.703003:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:3.0:1788940740.703016:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82f3b232-46da-4a78-8599-45df2ddbced0+7:2404:x1875839921763456:12345-192.168.202.25@tcp:4:lfs.0 00000100:00100000:1.0:1788940740.703910:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8438:1875839944915840:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940740.703944:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddc29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940740.705749:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82f3b232-46da-4a78-8599-45df2ddbced0+9:2404:x1875839921763456:12345-192.168.202.25@tcp:4:lfs.0 Request processed in 2716us (3117us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788940740.705789:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 2 00002000:00100000:0.0:1788940740.705805:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff91d018b08700 x1875839921763456/t4294967306(0) o4->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:716/0 lens 504/448 e 0 to 0 dl 1788940751 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788940740.705815:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91d018b08700 with x1875839921763456 ext(0->12) 00010000:00010000:0.0:1788940740.705828:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a535b544/0x9c34acc08baddbdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc744a expref: 9 pid: 8437 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.705852:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a535b544/0x9c34acc08baddbdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc744a expref: 9 pid: 8437 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940740.705861:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91d018b08700 00000100:00100000:2.0:1788940740.709168:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940740.709296:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921763584 00000100:00100000:0.0:1788940740.709377:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921763584 00010000:00010000:0.0:1788940740.709441:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a535b544/0x9c34acc08baddbdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc744a expref: 9 pid: 8437 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940740.709604:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 82 00000100:00100000:0.0:1788940740.709618:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+9:2405:x1875839921763584:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940740.709639:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788940740.709664:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788940740.709668:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788940741 00002000:00010000:0.0:1788940740.709671:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788940741 00002000:00010000:0.0:1788940740.709673:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788940741 00002000:00010000:0.0:1788940740.709675:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788940740.709683:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a535b544/0x9c34acc08baddbdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc744a expref: 9 pid: 8437 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.709715:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a535b544/0x9c34acc08baddbdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc744a expref: 9 pid: 8437 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.709760:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a535b544/0x9c34acc08baddbdc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc744a expref: 9 pid: 8437 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.709780:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940740.709784:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940740.709791:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddc29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.709801:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddc29 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.709902:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940740.710031:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+8:2405:x1875839921763584:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 414us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940740.710040:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 82 00010000:00010000:1.0:1788940740.710168:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddc29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.710179:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddc29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.710207:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddc29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.710216:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddc29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.710225:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddc29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.710233:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940740.710238:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddc29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.710249:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddc29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.710283:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddc29 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.710317:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08baddc29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940740.710381:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:2407:x1875839921763328:12345-192.168.202.25@tcp:1:lfs.0 Request processed in 11952us (12298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940740.710390:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:2.0:1788940740.713318:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940740.713470:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921763840 00000100:00100000:1.0:1788940740.713483:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921763840 00000100:00100000:1.0:1788940740.713558:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 38 00000100:00100000:1.0:1788940740.713571:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d002e64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+25:12278:x1875839921763840:12345-192.168.202.25@tcp:35:lfs.0 00000004:00010000:1.0:1788940740.713659:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddc1b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7466 expref: 25 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788940740.713934:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788940740.714162:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:1.0:1788940740.714721:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:1.0:1788940740.714789:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc30 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.714811:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddbc7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc743c expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.714823:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc30 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.714875:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddbc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc743c expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.714911:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddbc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc743c expref: 29 pid: 6521 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940740.714930:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1875839944915968:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940740.715170:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30780 going to sleep for 11 seconds 00000100:00100000:0.0:1788940740.719901:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1875839944915968:192.168.202.25@tcp:104: 00010000:00010000:0.0:1788940740.719947:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc30 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940740.721997:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940740.722678:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921763968 00000100:00100000:1.0:1788940740.722692:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921763968 00010000:00010000:1.0:1788940740.722794:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddbc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc743c expref: 30 pid: 6521 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940740.722850:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 83 00000100:00100000:1.0:1788940740.722863:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+30:2404:x1875839921763968:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940740.722884:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940740.722891:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddbc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc743c expref: 30 pid: 6521 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.722907:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddbc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc743c expref: 30 pid: 6521 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.722934:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddbc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc743c expref: 30 pid: 6521 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.722953:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91d03ed37b00) 00010000:00010000:1.0:1788940740.722958:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc30 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.723007:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.723017:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc30 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.723064:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940740.723144:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+29:2404:x1875839921763968:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 283us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940740.723152:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 83 00010000:00010000:2.0:1788940740.724095:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.724108:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940740.724316:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:2.0:1788940740.724473:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1788940740.724587:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037887800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875839944916096:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788940740.724660:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940740.724703:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c7fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940740.724924:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944916096 00000100:00100000:3.0:1788940740.724933:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944916096 00000100:00100000:3.0:1788940740.724999:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788940740.725009:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1875839944916096:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788940740.725124:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1875839944916096:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 117us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940740.725133:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788940740.725752:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037887800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875839944916096:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788940740.725945:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:2.0:1788940740.726036:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037887800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875839944916224:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788940740.726086:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940740.726163:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c7fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940740.726754:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944916224 00000100:00100000:0.0:1788940740.726765:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944916224 00000100:00100000:0.0:1788940740.726820:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788940740.726830:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1875839944916224:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788940740.727176:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6524:x1875839944916224:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 346us (1088us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788940740.727185:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788940740.727700:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037887800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875839944916224:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788940740.727805:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1788940740.727872:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.727885:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc30 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.727894:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc30 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.727902:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940740.727907:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc30 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.727916:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc30 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.727936:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91d03ed37b00) 00010000:00010000:2.0:1788940740.727939:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788940740.727946:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc30 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940740.727953:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc30 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788940740.728150:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788940740.728231:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1788940740.728244:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 496060986471ns, next at 497060983517ns, rc = 0 00000001:00080000:2.0:1788940740.728252:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:2.0:1788940740.728435:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91d03ed37b00) 00010000:00010000:2.0:1788940740.728439:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788940740.728448:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddc1b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7466 expref: 33 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940740.728749:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d002e64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+32:12278:x1875839921763840:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 15169us (15482us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788940740.728761:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 38 00000020:00080000:2.0:1788940740.728767:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788940740.731962:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940740.732127:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921764096 00000100:00100000:1.0:1788940740.732141:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921764096 00000100:00100000:1.0:1788940740.732290:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 162 00000100:00100000:1.0:1788940740.732314:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+32:12278:x1875839921764096:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788940740.732346:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940740.732377:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08baddc37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc746d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.732454:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08baddc37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc746d expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.732484:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08baddc37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc746d expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.732507:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:1.0:1788940740.732510:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940740.732515:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603800, rc 0) 00000100:00100000:1.0:1788940740.732605:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+33:12278:x1875839921764096:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 304us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940740.732613:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 162 00000100:00100000:3.0:1788940740.736488:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940740.736776:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921764352 00000100:00100000:0.0:1788940740.736793:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921764352 00000100:00100000:0.0:1788940740.736883:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00100000:0.0:1788940740.736897:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0854b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+33:12278:x1875839921764352:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1788940740.737344:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0854b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+34:12278:x1875839921764352:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 448us (882us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788940740.737354:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00100000:2.0:1788940740.872324:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940740.872527:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921764608 00000100:00100000:3.0:1788940740.872543:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921764608 00000100:00100000:3.0:1788940740.872628:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 163 00000100:00100000:3.0:1788940740.872643:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+34:12288:x1875839921764608:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940740.872707:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940740.872748:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddc3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7474 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940740.873033:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788940740.873178:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddc3e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7474 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.873194:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65400) 00010000:00010000:3.0:1788940740.873197:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788940740.873204:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddc3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7474 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.873223:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936e00, rc 0) 00000100:00100000:3.0:1788940740.874559:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+35:12288:x1875839921764608:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 1911us (2311us total) trans 4294967436 rc 301/301 00000100:00100000:3.0:1788940740.874570:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 163 00000100:00100000:3.0:1788940740.887185:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940740.887337:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921764736 00000100:00100000:0.0:1788940740.887353:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921764736 00000100:00100000:0.0:1788940740.887439:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 164 00000100:00100000:0.0:1788940740.887452:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+35:12288:x1875839921764736:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:0.0:1788940740.887566:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddc4c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.887590:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddc4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.887607:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddc4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.887622:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddc53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.887630:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddc53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.887661:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddc53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.887787:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddc5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.887809:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddc5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.887817:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddc5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940740.887885:0:9713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddc5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.887902:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddc4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.887909:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddc4c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.887923:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddc4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.887929:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940740.887934:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddc4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.887943:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddc4c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.887956:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:0.0:1788940740.887966:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940740.887974:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddc4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.887982:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddc4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.888002:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddc53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.888008:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddc53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.888015:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddc53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.888020:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940740.888023:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddc53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.888029:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddc53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.888036:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91d03ed37300) 00010000:00010000:0.0:1788940740.888038:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940740.888041:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddc53 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.888047:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddc53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.888056:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddc5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.888069:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddc5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.888075:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddc5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.888081:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000030e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940740.888084:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddc5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.888090:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddc5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.888098:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:0.0:1788940740.888101:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940740.888105:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddc5a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940740.888111:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddc5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940740.888218:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+35:12288:x1875839921764736:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 766us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940740.888228:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 164 00010000:00010000:3.0:1788940740.891523:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940740.891598:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940740.891703:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921764992 00000100:00100000:3.0:1788940740.891718:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921764992 00000100:00100000:3.0:1788940740.891911:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:3.0:1788940740.893117:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+35:12288:x1875839921764992:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:3.0:1788940740.893508:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+36:12288:x1875839921764992:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 1582us (1915us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788940740.901736:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:2.0:1788940740.970616:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940740.970956:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921765248 00000100:00100000:1.0:1788940740.970970:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921765248 00000100:00100000:1.0:1788940740.971060:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 165 00000100:00100000:1.0:1788940740.971074:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+36:12291:x1875839921765248:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788940740.971111:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940740.971140:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08baddc61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc747b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.971243:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc68 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.971385:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.971403:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.971416:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddc6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.971424:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddc6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.971431:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddc6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.971604:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddc76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.971634:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddc76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.971642:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddc76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940740.971655:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788940740.972167:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.972177:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc68 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.972185:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.972192:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940740.972197:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.972206:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc68 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.972221:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:1.0:1788940740.972224:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940740.972230:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.972238:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08baddc68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.972381:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddc6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.972397:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddc6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.972404:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddc6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.972409:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940740.972413:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddc6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.972420:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddc6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.972430:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91d03ed37300) 00010000:00010000:1.0:1788940740.972433:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940740.972437:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddc6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.972443:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddc6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.972509:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08baddc61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc747b expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.972528:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddc76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc747b expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.972536:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:1.0:1788940740.972539:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940740.972548:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603000, rc 0) 00000100:00100000:1.0:1788940740.972969:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+38:12291:x1875839921765248:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 1587us (2057us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788940740.972981:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 165 00000100:00100000:0.0:1788940740.976701:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940740.976811:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921765376 00000100:00100000:3.0:1788940740.976827:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921765376 00000100:00100000:3.0:1788940740.976922:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 166 00000100:00100000:3.0:1788940740.976937:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+38:12291:x1875839921765376:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:3.0:1788940740.977071:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddc84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.977098:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddc84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.977114:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddc84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.977163:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddc84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.977170:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddc84 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.977178:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddc84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.977185:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940740.977189:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddc84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.977199:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddc84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.977213:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:3.0:1788940740.977217:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788940740.977224:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddc84 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.977244:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddc84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940740.977660:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+38:12291:x1875839921765376:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 722us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940740.977670:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 166 00000100:00100000:3.0:1788940740.987975:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940740.988113:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921765632 00000100:00100000:2.0:1788940740.988129:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921765632 00000100:00100000:2.0:1788940740.988208:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 41 00000100:00100000:2.0:1788940740.988221:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+38:12291:x1875839921765632:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:2.0:1788940740.988663:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+39:12291:x1875839921765632:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 443us (700us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788940740.988672:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 41 00000100:00100000:2.0:1788940741.356538:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940741.356674:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921765888 00000100:00100000:0.0:1788940741.356689:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921765888 00000100:00100000:0.0:1788940741.356807:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 167 00000100:00100000:0.0:1788940741.356821:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+39:12322:x1875839921765888:12345-192.168.202.25@tcp:101:cat.0 00010000:00010000:0.0:1788940741.356861:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940741.356889:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddc8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7482 expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.357041:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddc92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.357060:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddc92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.357076:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddc92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940741.357091:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788940741.357246:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddc8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7482 expref: 42 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.357313:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddc92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7482 expref: 41 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.357323:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:0.0:1788940741.357327:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940741.357332:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d000031c00, rc 0) 00000100:00100000:0.0:1788940741.357433:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+41:12322:x1875839921765888:12345-192.168.202.25@tcp:101:cat.0 Request processed in 616us (911us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1788940741.357467:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 167 00000100:00100000:0.0:1788940741.361123:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940741.361183:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940741.361503:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921766016 00000100:00100000:3.0:1788940741.361518:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921766016 00000100:00100000:3.0:1788940741.361603:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:3.0:1788940741.361616:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+41:2404:x1875839921766016:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940741.361654:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940741.361696:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddc92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7482 expref: 41 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940741.361723:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:3.0:1788940741.361730:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940741.361826:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+40:2404:x1875839921766016:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 211us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940741.361835:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:2.0:1788940741.374953:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921766272 00000100:00100000:2.0:1788940741.374985:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921766272 00000100:00100000:2.0:1788940741.375087:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00100000:2.0:1788940741.375100:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+40:12322:x1875839921766272:12345-192.168.202.25@tcp:35:cat.0 00000100:00100000:2.0:1788940741.375924:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+41:12322:x1875839921766272:12345-192.168.202.25@tcp:35:cat.0 Request processed in 822us (14734us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788940741.375937:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00100000:0.0:1788940741.500478:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940741.500574:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921766528 00000100:00100000:1.0:1788940741.500589:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921766528 00000100:00100000:1.0:1788940741.500687:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 168 00000100:00100000:1.0:1788940741.500700:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+41:12328:x1875839921766528:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:1.0:1788940741.500744:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940741.500749:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788940741.500791:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08baddbf8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7458 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940741.500820:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:1.0:1788940741.500826:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940741.500843:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08baddca0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7489 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940741.500989:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08baddca7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940741.501007:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddc76 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc747b expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940741.501016:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08baddca7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940741.501893:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddc76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc747b expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940741.501938:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddc76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc747b expref: 41 pid: 6522 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940741.501956:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944916352:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940741.503976:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940741.530588:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940741.530771:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944916352:192.168.202.25@tcp:104: 00010000:00010000:2.0:1788940741.530812:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08baddca7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940741.530936:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921766656 00000100:00100000:0.0:1788940741.530948:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921766656 00010000:00010000:0.0:1788940741.531001:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddc76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc747b expref: 42 pid: 6522 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940741.531057:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 84 00000100:00100000:0.0:1788940741.531082:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+42:2405:x1875839921766656:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940741.531103:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940741.531111:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddc76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc747b expref: 42 pid: 6522 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.531126:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddc76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc747b expref: 42 pid: 6522 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.531154:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08baddc76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc747b expref: 42 pid: 6522 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.531181:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:0.0:1788940741.531199:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08baddca7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.531210:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08baddca7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.531231:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08baddca7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.531327:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940741.531414:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+41:2405:x1875839921766656:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 333us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940741.531421:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 84 00010000:00010000:2.0:1788940741.531779:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08baddca7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940741.531789:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08baddca7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940741.531819:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788940741.532023:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08baddca0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7489 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940741.532048:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08baddca7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7489 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940741.532055:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:2.0:1788940741.532068:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788940741.532072:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602600, rc 0) 00000100:00100000:2.0:1788940741.532110:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+41:12328:x1875839921766528:12345-192.168.202.25@tcp:101:dd.0 Request processed in 31414us (31648us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788940741.532119:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 168 00000100:00100000:2.0:1788940741.539507:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940741.539796:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921766784 00000100:00100000:0.0:1788940741.539810:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921766784 00000100:00100000:0.0:1788940741.539898:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 169 00000100:00100000:0.0:1788940741.539912:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0852e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+41:12328:x1875839921766784:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:0.0:1788940741.539943:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940741.539973:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08baddcb5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7490 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.540023:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddcbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.540041:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddcbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.540057:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddcbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.540235:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08baddcb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7490 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.540299:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddcbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7490 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940741.540317:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:0.0:1788940741.540320:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788940741.540326:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d000031200, rc 0) 00000100:00100000:0.0:1788940741.540415:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0852e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+42:12328:x1875839921766784:12345-192.168.202.25@tcp:101:dd.0 Request processed in 506us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940741.540423:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 169 00000100:00100000:0.0:1788940741.546597:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940741.546929:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921767040 00000100:00100000:3.0:1788940741.546944:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921767040 00000100:00100000:3.0:1788940741.547019:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 170 00000100:00100000:3.0:1788940741.547031:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+42:12328:x1875839921767040:12345-192.168.202.25@tcp:36:dd.0 00010000:00010000:3.0:1788940741.547875:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddcc3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940741.547905:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddcc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940741.547947:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddcc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940741.548007:0:8517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788940741.548033:0:8517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049e14754 reply state 00000000259b4343 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddcc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940741.548048:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddcc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940741.548057:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:3.0:1788940741.548073:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788940741.548078:0:8517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940741.548504:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+45:12328:x1875839921767040:12345-192.168.202.25@tcp:36:dd.0 Request processed in 1470us (1919us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788940741.548515:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 170 00000020:00080000:3.0:1788940741.548521:0:8517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788940741.791529:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944916480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940741.791636:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940741.791936:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944916480 00000100:00100000:1.0:1788940741.791947:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944916480 00000100:00100000:1.0:1788940741.792027:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788940741.792049:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944916480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788940741.792108:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788940741.804372:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944916480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 12317us (12717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940741.804393:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788940741.806420:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944916480:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788940741.915568:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940741.928420:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940741.928475:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940741.928516:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940741.928548:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940741.928566:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940741.928590:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940741.928607:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940741.928650:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921767424 00000100:00100000:2.0:1788940741.928661:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921767424 00000100:00100000:2.0:1788940741.928709:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921767936 00000100:00100000:2.0:1788940741.928711:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921767936 00000100:00100000:2.0:1788940741.928721:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921767296 00000100:00100000:2.0:1788940741.928723:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921767296 00000100:00100000:2.0:1788940741.928745:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921767808 00000100:00100000:2.0:1788940741.928748:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921767808 00000100:00100000:2.0:1788940741.928765:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 383 00000100:00100000:2.0:1788940741.928775:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921767424:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940741.928870:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921767424:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 96us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940741.928878:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 383 00000100:00100000:2.0:1788940741.928896:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 384 00000100:00100000:2.0:1788940741.928902:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2406:x1875839921767936:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940741.928927:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2406:x1875839921767936:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 25us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940741.928933:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 384 00000100:00100000:2.0:1788940741.928944:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 385 00000100:00100000:2.0:1788940741.928949:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+45:2406:x1875839921767296:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940741.928961:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921767168 00000100:00100000:0.0:1788940741.928965:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921767168 00000100:00100000:2.0:1788940741.928977:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+45:2406:x1875839921767296:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 28us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940741.928983:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 385 00000100:00100000:0.0:1788940741.928991:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 403 00000100:00100000:2.0:1788940741.928992:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 386 00000100:00100000:2.0:1788940741.928998:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2406:x1875839921767808:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940741.928998:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2406:x1875839921767168:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940741.929018:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2406:x1875839921767808:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 21us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940741.929020:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2406:x1875839921767168:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 23us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940741.929027:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 403 00000100:00100000:2.0:1788940741.929029:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 386 00000100:00080000:2.0:1788940741.929047:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788940741.929052:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921767680 00000100:00100000:0.0:1788940741.929056:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921767680 00000100:00100000:0.0:1788940741.929076:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921767552 00000100:00100000:0.0:1788940741.929078:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921767552 00000100:00100000:0.0:1788940741.929102:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 147 00000100:00100000:0.0:1788940741.929108:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+7:2406:x1875839921767680:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940741.929131:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+7:2406:x1875839921767680:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 23us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940741.929143:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 147 00000100:00100000:0.0:1788940741.929167:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 148 00000100:00100000:0.0:1788940741.929174:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2406:x1875839921767552:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940741.929197:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2406:x1875839921767552:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 23us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940741.929203:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 148 00000100:00080000:0.0:1788940741.929220:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940742.083235:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940742.083512:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921768064 00000100:00100000:3.0:1788940742.083527:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921768064 00000100:00100000:3.0:1788940742.083635:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 171 00000100:00100000:3.0:1788940742.083650:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+45:12342:x1875839921768064:12345-192.168.202.25@tcp:101:stat.0 00010000:00010000:3.0:1788940742.083677:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940742.083706:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08baddcca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7497 expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.083874:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddcd1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.083894:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddcd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.083916:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddcd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.083930:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddcd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.083938:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.083945:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.084043:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddcdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.084055:0:9713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08baddca7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7489 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.084064:0:9713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddcdf lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.084105:0:9713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08baddca7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7489 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.084244:0:9713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08baddca7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7489 expref: 46 pid: 6522 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940742.084454:0:9713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9713:1875839944916608:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788940742.084566:0:9713:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06eb3240 going to sleep for 11 seconds 00000100:00080000:0.0:1788940742.084646:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940742.091219:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940742.093494:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921768320 00000100:00100000:1.0:1788940742.093515:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921768320 00000100:00100000:1.0:1788940742.093607:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:1.0:1788940742.093621:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+47:6190:x1875839921768320:12345-192.168.202.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788940742.093998:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+48:6190:x1875839921768320:12345-192.168.202.25@tcp:35:ldlm_bl.0 Request processed in 379us (2789us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1788940742.094007:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:3.0:1788940742.099122:0:9713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9713:1875839944916608:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940742.099172:0:9713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddcdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940742.099724:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940742.099828:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921768448 00000100:00100000:3.0:1788940742.099839:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921768448 00010000:00010000:3.0:1788940742.099896:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08baddca7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7489 expref: 48 pid: 6522 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940742.099945:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 85 00000100:00100000:3.0:1788940742.099957:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+48:2405:x1875839921768448:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940742.099974:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940742.099980:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08baddca7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7489 expref: 48 pid: 6522 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.099994:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08baddca7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7489 expref: 48 pid: 6522 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.100019:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08baddca7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7489 expref: 48 pid: 6522 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.100038:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:3.0:1788940742.100044:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddcdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.100054:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddcdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.100062:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddcdf lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.100149:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940742.100216:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+47:2405:x1875839921768448:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 260us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940742.100224:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 85 00010000:00010000:2.0:1788940742.104627:0:9713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddcdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.104647:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddcdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940742.104744:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788940742.104752:0:9713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788940742.104788:0:9713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddcdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.104807:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddcdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.104821:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddcd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.104828:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddcd1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.104837:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddcd1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.104844:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940742.104848:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddcd1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.104888:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddcd1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.104908:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:2.0:1788940742.104911:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940742.104918:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddcd1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.104924:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddcd1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.104943:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.104949:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddcd8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.104955:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddcd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.104959:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940742.104962:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddcd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.104968:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddcd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.104975:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91d03ed37300) 00010000:00010000:2.0:1788940742.104978:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940742.104981:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddcd8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.104999:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddcd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.105050:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08baddcca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7497 expref: 47 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.105066:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddcdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7497 expref: 46 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.105073:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:2.0:1788940742.105075:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940742.105078:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937c00, rc 0) 00000100:00100000:2.0:1788940742.105225:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+46:12342:x1875839921768064:12345-192.168.202.25@tcp:101:stat.0 Request processed in 21578us (22000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940742.105236:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 171 00000100:00100000:2.0:1788940742.203505:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940742.203599:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921768704 00000100:00100000:1.0:1788940742.203611:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921768704 00000100:00100000:1.0:1788940742.203679:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 172 00000100:00100000:1.0:1788940742.203702:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+46:12347:x1875839921768704:12345-192.168.202.25@tcp:36:truncate.0 00010000:00010000:1.0:1788940742.203780:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940742.203810:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddcdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7497 expref: 46 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940742.203832:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:1.0:1788940742.203838:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940742.204013:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddce6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940742.204029:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddce6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940742.204039:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddce6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788940742.204824:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:1.0:1788940742.204857:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000baf41f24 reply state 00000000e8fe1ee1 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddce6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940742.204872:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddce6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940742.204878:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:1.0:1788940742.204881:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788940742.204884:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940742.204996:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+48:12347:x1875839921768704:12345-192.168.202.25@tcp:36:truncate.0 Request processed in 1294us (1498us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788940742.205003:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 172 00000020:00080000:1.0:1788940742.205008:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788940742.299699:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944916736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940742.299792:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940742.299937:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944916736 00000100:00100000:2.0:1788940742.299946:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944916736 00000100:00100000:2.0:1788940742.300011:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788940742.300022:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944916736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788940742.300053:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788940742.300100:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944916736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940742.300106:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:0.0:1788940742.300321:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940742.300361:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944916736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940742.300633:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944916864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940742.300668:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940742.300791:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944916864 00000100:00100000:1.0:1788940742.300796:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944916864 00000100:00100000:1.0:1788940742.300840:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788940742.300847:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944916864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940742.300859:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788940742.300889:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944916864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940742.300895:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1788940742.300947:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940742.301004:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944916864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940742.466050:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940742.466330:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921768832 00000100:00100000:3.0:1788940742.466346:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921768832 00000100:00100000:3.0:1788940742.466436:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 173 00000100:00100000:3.0:1788940742.466461:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+48:12362:x1875839921768832:12345-192.168.202.25@tcp:101:stat.0 00010000:00010000:3.0:1788940742.466497:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940742.466530:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddced lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc749e expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.466622:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddcf4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.466641:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddcf4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.466656:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddcf4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.466668:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddcfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.466677:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddcfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.466706:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddcfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.466842:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.466853:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.466861:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940742.466916:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788940742.466921:0:8517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940742.466950:0:8517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.466965:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.466974:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddcf4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.466983:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddcf4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.466991:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddcf4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.466997:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940742.467003:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddcf4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.467023:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddcf4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.467038:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:3.0:1788940742.467042:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940742.467050:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddcf4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.467057:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddcf4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.467074:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddcfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.467081:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddcfb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.467088:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddcfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.467093:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940742.467106:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddcfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.467113:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddcfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.467121:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91d03ed37300) 00010000:00010000:3.0:1788940742.467123:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940742.467127:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddcfb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.467145:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddcfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.467178:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddced lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc749e expref: 50 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.467194:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc749e expref: 49 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.467201:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:3.0:1788940742.467203:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940742.467206:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937200, rc 0) 00000100:00100000:3.0:1788940742.467409:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+49:12362:x1875839921768832:12345-192.168.202.25@tcp:101:stat.0 Request processed in 960us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940742.467418:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 173 00000100:00100000:2.0:1788940742.593233:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940742.593717:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921769088 00000100:00100000:3.0:1788940742.596546:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921769088 00000100:00100000:3.0:1788940742.596664:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 174 00000100:00100000:3.0:1788940742.596679:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+49:12372:x1875839921769088:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940742.596713:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940742.596752:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddd09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc74a5 expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940742.597661:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788940742.598227:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddd09 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74a5 expref: 51 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.598887:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65400) 00010000:00010000:3.0:1788940742.598891:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788940742.598898:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddd09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74a5 expref: 51 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.598918:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936a00, rc 0) 00000100:00100000:3.0:1788940742.599083:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+50:12372:x1875839921769088:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 2406us (5868us total) trans 4294967448 rc 301/301 00000100:00100000:3.0:1788940742.599093:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 174 00000100:00100000:0.0:1788940742.604705:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940742.604905:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921769344 00000100:00100000:2.0:1788940742.604943:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921769344 00000100:00100000:2.0:1788940742.605026:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:2.0:1788940742.605038:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d002e65850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+50:12372:x1875839921769344:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:2.0:1788940742.605675:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d002e65850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+51:12372:x1875839921769344:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 637us (985us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788940742.605685:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:0.0:1788940742.673038:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940742.673308:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921769600 00000100:00100000:2.0:1788940742.673323:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921769600 00000100:00100000:2.0:1788940742.673403:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 175 00000100:00100000:2.0:1788940742.673415:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+51:12378:x1875839921769600:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1788940742.673452:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940742.673478:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08baddd17 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc74ac expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.673631:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd1e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.673656:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc749e expref: 52 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.673667:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd1e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.673712:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc749e expref: 52 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.673737:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc749e expref: 52 pid: 8517 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940742.673791:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d0b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875839944916992:192.168.202.25@tcp:104: 00000100:00100000:2.0:1788940742.673929:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c7f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788940742.688166:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940742.688572:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921769728 00000100:00100000:0.0:1788940742.688589:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921769728 00010000:00010000:0.0:1788940742.688659:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd02 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc749e expref: 53 pid: 8517 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940742.688711:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 86 00000100:00100000:0.0:1788940742.688736:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+53:2405:x1875839921769728:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940742.688758:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940742.688766:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd02 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc749e expref: 53 pid: 8517 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.688813:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc749e expref: 53 pid: 8517 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.688845:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:0.0:1788940742.688853:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd1e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.688865:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd1e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.688875:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd1e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.688902:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940742.688999:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+53:2405:x1875839921769728:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 275us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940742.689008:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 86 00010000:00010000:0.0:1788940742.689078:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc749e expref: 52 pid: 8517 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940742.689105:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d0b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875839944916992:192.168.202.25@tcp:104: 00010000:00010000:0.0:1788940742.689131:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd1e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.689142:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd1e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.689149:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd1e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940742.689182:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788940742.689428:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08baddd17 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74ac expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.689445:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd1e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74ac expref: 52 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.689454:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:0.0:1788940742.689457:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788940742.689460:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7600, rc 0) 00000100:00100000:0.0:1788940742.689495:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+52:12378:x1875839921769600:12345-192.168.202.25@tcp:101:bash.0 Request processed in 16082us (16473us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788940742.689504:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 175 00000100:00100000:0.0:1788940742.694652:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940742.694967:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921769984 00000100:00100000:3.0:1788940742.695088:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921769984 00000100:00100000:3.0:1788940742.695190:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 176 00000100:00100000:3.0:1788940742.695203:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+52:12378:x1875839921769984:12345-192.168.202.25@tcp:36:bash.0 00010000:00010000:3.0:1788940742.695605:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddd2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.695630:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddd2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.695646:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddd2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940742.695704:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:3.0:1788940742.695740:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032db1326 reply state 0000000070a5daa2 transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddd2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.695797:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddd2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.695805:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:3.0:1788940742.695808:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788940742.695813:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940742.695959:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+55:12378:x1875839921769984:12345-192.168.202.25@tcp:36:bash.0 Request processed in 756us (1322us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788940742.695967:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 176 00000020:00080000:3.0:1788940742.697884:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788940742.708013:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940742.708240:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921770112 00000100:00100000:3.0:1788940742.708300:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921770112 00000100:00100000:3.0:1788940742.708379:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 177 00000100:00100000:3.0:1788940742.708393:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+55:12378:x1875839921770112:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1788940742.708428:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940742.708457:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddd33 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc74b3 expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.708584:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddd3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.708604:0:9713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd1e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74ac expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.708615:0:9713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddd3a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.708664:0:9713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd1e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74ac expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.708701:0:9713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd1e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74ac expref: 56 pid: 6520 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940742.708719:0:9713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06108a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9713:1875839944917120:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788940742.708852:0:9713:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06eb3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788940742.712462:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940742.712794:0:9713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06108a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9713:1875839944917120:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940742.712836:0:9713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddd3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940742.713104:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921770240 00000100:00100000:1.0:1788940742.713116:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921770240 00010000:00010000:1.0:1788940742.713170:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd1e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74ac expref: 57 pid: 6520 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940742.713220:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 87 00000100:00100000:1.0:1788940742.713233:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+57:2405:x1875839921770240:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940742.713253:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940742.713459:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd1e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74ac expref: 57 pid: 6520 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940742.713476:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd1e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74ac expref: 57 pid: 6520 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940742.713504:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd1e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74ac expref: 57 pid: 6520 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940742.713523:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:1.0:1788940742.713529:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddd3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940742.713561:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddd3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940742.713571:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddd3a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940742.713609:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940742.713756:0:9713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddd3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.713764:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddd3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940742.713839:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788940742.713845:0:9713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940742.713873:0:9713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddd3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.713915:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddd33 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74b3 expref: 57 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.713934:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddd3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74b3 expref: 56 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.713941:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:3.0:1788940742.713952:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940742.713956:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937800, rc 0) 00000100:00100000:1.0:1788940742.714114:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+56:2405:x1875839921770240:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 881us (1667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940742.714124:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 87 00000100:00100000:3.0:1788940742.714482:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+55:12378:x1875839921770112:12345-192.168.202.25@tcp:101:bash.0 Request processed in 6091us (6483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940742.714491:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 177 00000100:00100000:2.0:1788940742.717202:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940742.717443:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921770496 00000100:00100000:1.0:1788940742.717457:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921770496 00000100:00100000:0.0:1788940742.717715:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00100000:0.0:1788940742.717738:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+55:12378:x1875839921770496:12345-192.168.202.25@tcp:35:bash.0 00000100:00100000:0.0:1788940742.718090:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+56:12378:x1875839921770496:12345-192.168.202.25@tcp:35:bash.0 Request processed in 355us (904us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788940742.718109:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00100000:2.0:1788940742.831460:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940742.831644:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921770752 00000100:00100000:0.0:1788940742.831668:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921770752 00000100:00100000:0.0:1788940742.831762:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 178 00000100:00100000:0.0:1788940742.831777:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+56:12388:x1875839921770752:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1788940742.831835:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940742.831866:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddd41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc74ba expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940742.832234:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788940742.832424:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddd41 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74ba expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.832510:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65400) 00010000:00010000:0.0:1788940742.832514:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940742.832521:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddd41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74ba expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.832541:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d000031c00, rc 0) 00000100:00100000:0.0:1788940742.832796:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+57:12388:x1875839921770752:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 1021us (1359us total) trans 4294967454 rc 301/301 00000100:00100000:0.0:1788940742.832806:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 178 00000100:00100000:3.0:1788940742.847544:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940742.848115:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921770880 00000100:00100000:2.0:1788940742.848132:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921770880 00000100:00100000:2.0:1788940742.848229:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 179 00000100:00100000:2.0:1788940742.848242:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+57:12388:x1875839921770880:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:2.0:1788940742.848425:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08baddd4f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.848464:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08baddd4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.848481:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08baddd4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.848496:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddd56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.848504:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddd56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.848511:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddd56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.848611:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.848830:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.848838:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940742.848911:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.848927:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08baddd4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.848934:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08baddd4f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.848943:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08baddd4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.848950:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940742.848955:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08baddd4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.848963:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08baddd4f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.849550:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:2.0:1788940742.849557:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940742.849563:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08baddd4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.849572:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08baddd4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.849602:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddd56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.849835:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddd56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.849842:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddd56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.849849:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940742.849852:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddd56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.849859:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddd56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.849868:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91d03ed37300) 00010000:00010000:2.0:1788940742.849871:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940742.849874:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddd56 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.849880:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08baddd56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.849891:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.849897:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd5d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.849903:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.849916:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940742.849920:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.849926:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd5d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.849934:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:2.0:1788940742.849936:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940742.849939:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd5d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.849945:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940742.850832:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+57:12388:x1875839921770880:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 2581us (3297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940742.850847:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 179 00000100:00100000:3.0:1788940742.860537:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940742.860823:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921771136 00000100:00100000:2.0:1788940742.860837:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921771136 00000100:00100000:2.0:1788940742.860922:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:2.0:1788940742.860934:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+57:12388:x1875839921771136:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:3.0:1788940742.862144:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+58:12388:x1875839921771136:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 1202us (1891us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788940742.862158:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:2.0:1788940742.908456:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940742.908655:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921771392 00000100:00100000:3.0:1788940742.908671:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921771392 00000100:00100000:3.0:1788940742.908774:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 180 00000100:00100000:3.0:1788940742.908789:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+58:12391:x1875839921771392:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940742.908826:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940742.908859:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08baddd64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc74c1 expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.909060:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddd6b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.909080:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddd6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.909099:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddd6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.909137:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.909146:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940742.909153:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.909941:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddd79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.909958:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddd79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.910194:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddd79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940742.910211:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788940742.910508:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddd6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.910537:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddd6b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.910544:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddd6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.910552:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940742.910558:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddd6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.910567:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddd6b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.910583:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:0.0:1788940742.910586:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940742.910593:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddd6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.910600:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddd6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.910616:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.910621:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.910628:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.910633:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940742.910641:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.910647:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.910654:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91d03ed37300) 00010000:00010000:0.0:1788940742.910657:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940742.910659:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.910665:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddd72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.910743:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08baddd64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74c1 expref: 61 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.910765:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddd79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74c1 expref: 60 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940742.910773:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:0.0:1788940742.910776:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940742.910779:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d000031000, rc 0) 00000100:00100000:0.0:1788940742.910957:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+60:12391:x1875839921771392:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 2170us (2530us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788940742.910980:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 180 00000100:00100000:0.0:1788940742.915498:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940742.915661:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940742.915755:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921771648 00000100:00100000:1.0:1788940742.915772:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921771648 00000100:00100000:1.0:1788940742.916316:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:1.0:1788940742.916346:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+60:2406:x1875839921771648:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940742.916375:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940742.916408:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08baddd79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74c1 expref: 60 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940742.916433:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:1.0:1788940742.916439:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940742.916754:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921771520 00000100:00100000:2.0:1788940742.916762:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921771520 00000100:00100000:2.0:1788940742.916818:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 181 00000100:00100000:2.0:1788940742.916830:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+60:12391:x1875839921771520:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:2.0:1788940742.916925:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.916948:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.917002:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.917048:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.917056:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.917064:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.917071:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940742.917077:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.917085:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.917097:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:2.0:1788940742.917100:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940742.917106:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd87 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940742.917113:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddd87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940742.919137:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+60:2406:x1875839921771648:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 2792us (3460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940742.919153:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:2.0:1788940742.920571:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+59:12391:x1875839921771520:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 3724us (5070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940742.920590:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 181 00000100:00100000:1.0:1788940742.924071:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940742.924185:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921771904 00000100:00100000:0.0:1788940742.924200:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921771904 00000100:00100000:1.0:1788940742.929151:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:1.0:1788940742.929212:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+59:12391:x1875839921771904:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:1.0:1788940742.929826:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+60:12391:x1875839921771904:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 625us (5769us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1788940742.929838:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 47 00010000:00010000:0.0:1788940742.942134:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940743.148932:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940743.149047:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921772160 00000100:00100000:3.0:1788940743.149061:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921772160 00000100:00100000:3.0:1788940743.149139:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 182 00000100:00100000:3.0:1788940743.149151:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+60:12409:x1875839921772160:12345-192.168.202.25@tcp:101:cat.0 00010000:00010000:3.0:1788940743.149184:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940743.149211:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddd8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc74c8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.149413:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08baddd95 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.149435:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08baddd95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.149663:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08baddd95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940743.149681:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788940743.149858:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddd8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74c8 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.149912:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08baddd95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74c8 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.149922:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:3.0:1788940743.149927:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788940743.149932:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936200, rc 0) 00000100:00100000:3.0:1788940743.150034:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+62:12409:x1875839921772160:12345-192.168.202.25@tcp:101:cat.0 Request processed in 884us (1117us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788940743.150043:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 182 00000100:00100000:0.0:1788940743.199943:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940743.201600:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921772288 00000100:00100000:2.0:1788940743.201642:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921772288 00000100:00100000:2.0:1788940743.201761:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 183 00000100:00100000:2.0:1788940743.201776:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+62:12410:x1875839921772288:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1788940743.201812:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940743.201840:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddda3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc74cf expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940743.201931:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badddaa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940743.201950:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badddaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940743.201965:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badddaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940743.202022:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788940743.202027:0:9713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788940743.202054:0:9713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badddaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940743.202086:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08baddda3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74cf expref: 64 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940743.202112:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badddaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74cf expref: 63 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940743.202122:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:2.0:1788940743.202125:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940743.202130:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6800, rc 0) 00000100:00100000:2.0:1788940743.202236:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+63:12410:x1875839921772288:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 463us (2310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940743.202246:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 183 00000100:00100000:1.0:1788940743.211211:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940743.211844:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921772672 00000100:00100000:0.0:1788940743.211860:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921772672 00000100:00100000:0.0:1788940743.211939:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 48 00000100:00100000:0.0:1788940743.211952:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+63:12410:x1875839921772672:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1788940743.212375:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+64:12410:x1875839921772672:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 424us (1179us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788940743.212384:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 48 00000100:00100000:0.0:1788940743.216121:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940743.216386:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921772800 00000100:00100000:1.0:1788940743.216401:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921772800 00000100:00100000:1.0:1788940743.216485:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:1.0:1788940743.216497:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+64:12410:x1875839921772800:12345-192.168.202.25@tcp:103:lfs.0 00010000:00010000:1.0:1788940743.216515:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788940743.216547:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddd3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74b3 expref: 64 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940743.216571:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08baddd95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74c8 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940743.216585:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08baddc37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc746d expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940743.216597:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:1.0:1788940743.216603:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940743.216672:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+61:12410:x1875839921772800:12345-192.168.202.25@tcp:103:lfs.0 Request processed in 177us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940743.216679:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:1.0:1788940743.223046:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940743.223424:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921772928 00000100:00100000:2.0:1788940743.223438:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921772928 00000100:00100000:2.0:1788940743.223512:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 184 00000100:00100000:2.0:1788940743.223524:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+61:12410:x1875839921772928:12345-192.168.202.25@tcp:58:lfs.0 00010000:00010000:2.0:1788940743.223712:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badddb1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940743.223760:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badddb1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940743.223776:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badddb1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788940743.223915:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788940743.224090:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+61:12410:x1875839921772928:12345-192.168.202.25@tcp:58:lfs.0 Request processed in 566us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940743.224100:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 184 00000100:00100000:2.0:1788940743.253497:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940743.267918:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921773056 00000100:00100000:3.0:1788940743.267943:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921773056 00000100:00100000:3.0:1788940743.268058:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 185 00000100:00100000:3.0:1788940743.268073:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+61:12412:x1875839921773056:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940743.268104:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940743.268134:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badddb8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc74d6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268228:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badddbf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268249:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badddbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268299:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badddbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268314:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badddc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268344:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badddc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268352:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badddc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268454:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badddcd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268464:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badddcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268472:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badddcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940743.268527:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788940743.268533:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940743.268557:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badddcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268571:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badddcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268580:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badddbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268588:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badddbf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268595:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badddbf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268611:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940743.268617:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badddbf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268626:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badddbf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268640:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:3.0:1788940743.268643:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940743.268650:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badddbf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268656:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badddbf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268674:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badddc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268679:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badddc6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268685:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badddc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268691:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940743.268694:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badddc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268700:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badddc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268755:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91d03ed37300) 00010000:00010000:3.0:1788940743.268758:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940743.268761:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badddc6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268767:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badddc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268803:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badddb8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74d6 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268818:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badddcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74d6 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940743.268825:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:3.0:1788940743.268827:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940743.268830:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936200, rc 0) 00000100:00100000:3.0:1788940743.268929:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+62:12412:x1875839921773056:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 858us (15448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940743.268939:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 185 00000100:00100000:0.0:1788940743.326467:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940743.326499:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944917248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788940743.326602:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940743.327008:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944917248 00000100:00100000:2.0:1788940743.327019:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944917248 00000100:00100000:2.0:1788940743.327091:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788940743.327103:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944917248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940743.327150:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788940743.327220:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944917248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940743.327228:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788940743.329062:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944917248:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788940743.963881:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940744.097453:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940744.097469:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940744.097589:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788940744.097598:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788940744.097812:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1875839944917376:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788940744.097957:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08715a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940744.101769:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940744.101995:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1875839944917376:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788940744.102424:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921773184 00000100:00100000:3.0:1788940744.102435:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921773184 00000100:00100000:3.0:1788940744.102529:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 186 00000100:00100000:3.0:1788940744.102541:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+62:12423:x1875839921773184:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788940744.102586:0:9713:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788940744.102780:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+62:12423:x1875839921773184:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 239us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940744.102790:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 186 00000100:00080000:0.0:1788940744.103061:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940744.112630:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940744.112780:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921773312 00000100:00100000:0.0:1788940744.112796:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921773312 00000100:00100000:0.0:1788940744.112896:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 187 00000100:00100000:0.0:1788940744.112910:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+62:12423:x1875839921773312:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788940744.113020:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badddd4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113066:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badddd4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113081:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badddd4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113114:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddddb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113122:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddddb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113129:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddddb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113167:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddde2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113176:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddde2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113184:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddde2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940744.113247:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788940744.113253:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788940744.113645:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddde2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113662:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badddd4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113683:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badddd4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113691:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badddd4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113698:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940744.113702:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badddd4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113720:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badddd4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113736:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91cf07e67400) 00010000:00010000:0.0:1788940744.113739:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940744.113746:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badddd4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113753:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badddd4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113771:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddddb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113778:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddddb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113784:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddddb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113789:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000030e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940744.113798:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddddb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113804:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddddb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113812:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff91d0421d1300) 00010000:00010000:0.0:1788940744.113815:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940744.113817:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddddb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113823:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08baddddb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.113999:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddde2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.114006:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddde2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.114014:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddde2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.114019:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940744.114022:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddde2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.114028:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddde2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.114036:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:0.0:1788940744.114038:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940744.114049:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddde2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.114056:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08baddde2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940744.116419:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+62:12423:x1875839921773312:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 Request processed in 3493us (3785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940744.116440:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 187 00000100:00100000:0.0:1788940744.154679:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940744.154758:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921773568 00000100:00100000:1.0:1788940744.154772:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921773568 00000100:00100000:1.0:1788940744.154856:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 188 00000100:00100000:1.0:1788940744.154868:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+62:12423:x1875839921773568:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940744.154896:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940744.154922:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddde9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc74dd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.155064:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badddf0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.155083:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badddf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.155098:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badddf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940744.155111:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788940744.155223:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badddf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.155231:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badddf0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.155238:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badddf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.155245:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940744.155250:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badddf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.155306:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badddf0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.155323:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:1.0:1788940744.155326:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940744.155333:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badddf0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.155340:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badddf0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.155392:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddde9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74dd expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.155404:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91cf07e67400) 00010000:00010000:1.0:1788940744.155406:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788940744.155410:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddde9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74dd expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.155421:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603600, rc 0) 00000100:00100000:1.0:1788940744.155504:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+63:12423:x1875839921773568:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 638us (840us total) trans 4294967460 rc 301/301 00000100:00100000:1.0:1788940744.155512:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 188 00000100:00100000:3.0:1788940744.161689:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940744.162353:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921773696 00000100:00100000:0.0:1788940744.162373:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921773696 00000100:00100000:0.0:1788940744.162473:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 189 00000100:00100000:0.0:1788940744.162488:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+63:12423:x1875839921773696:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788940744.162544:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788940744.162737:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+63:12423:x1875839921773696:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 250us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940744.162746:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 189 00000100:00100000:0.0:1788940744.166946:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940744.167796:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921773952 00000100:00100000:1.0:1788940744.167816:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921773952 00000100:00100000:1.0:1788940744.167929:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 190 00000100:00100000:1.0:1788940744.167944:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+63:12423:x1875839921773952:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940744.168007:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940744.168012:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788940744.168059:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08badddaa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74cf expref: 63 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.168087:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:1.0:1788940744.168094:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940744.168114:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badddfe lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc74e4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788940744.168825:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788940744.169060:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badde05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.169081:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badde05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.169096:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badde05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.169179:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badddfe lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74e4 expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.169204:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badde05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74e4 expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.169212:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91cf06dfaa00) 00010000:00010000:1.0:1788940744.169215:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940744.169231:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602000, rc 0) 00000100:00100000:1.0:1788940744.169365:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+64:12423:x1875839921773952:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1423us (2439us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788940744.169376:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 190 00000100:00100000:1.0:1788940744.175228:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940744.175653:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921774208 00000100:00100000:0.0:1788940744.175669:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921774208 00000100:00100000:0.0:1788940744.175762:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 191 00000100:00100000:0.0:1788940744.175777:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+64:12423:x1875839921774208:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788940744.175862:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940744.175899:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08badde05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74e4 expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.175920:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91cf06dfaa00) 00010000:00010000:0.0:1788940744.175946:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940744.175984:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde13 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176002:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176014:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176030:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badde1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xfa496446 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176037:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badde1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa496446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176043:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badde1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa496446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176105:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176112:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde13 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176119:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde13 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176126:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000030e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940744.176131:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde13 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176141:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde13 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176155:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:0.0:1788940744.176158:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940744.176163:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde13 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176171:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde13 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176182:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badde1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa496446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176188:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badde1a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa496446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176193:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badde1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa496446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176200:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940744.176203:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badde1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa496446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176209:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badde1a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa496446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176214:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xfa496446 (ffff91d0421d1300) 00010000:00010000:0.0:1788940744.176216:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940744.176219:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badde1a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xfa496446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.176224:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badde1a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xfa496446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940744.176368:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+63:12423:x1875839921774208:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 594us (1157us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940744.176377:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 191 00000100:00100000:2.0:1788940744.192286:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940744.192484:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921774336 00000100:00100000:0.0:1788940744.192500:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921774336 00000100:00100000:0.0:1788940744.192612:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 192 00000100:00100000:0.0:1788940744.192629:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+63:12423:x1875839921774336:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940744.192940:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940744.192978:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badde21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc74eb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.193046:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.193069:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.193085:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.193345:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08badde21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74eb expref: 65 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.193368:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74eb expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.193378:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91d0421d1300) 00010000:00010000:0.0:1788940744.193389:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788940744.193395:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d000030e00, rc 0) 00000100:00100000:0.0:1788940744.193489:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+64:12423:x1875839921774336:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 863us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940744.193498:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 192 00000100:00100000:0.0:1788940744.203579:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940744.210771:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921774592 00000100:00100000:3.0:1788940744.211018:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921774592 00000100:00100000:3.0:1788940744.211284:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 193 00000100:00100000:3.0:1788940744.211299:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+64:12423:x1875839921774592:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788940744.211441:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badde2f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.211467:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badde2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.211483:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badde2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788940744.211760:0:9713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788940744.211774:0:9713:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 499544515762ns, next at 500544511657ns, rc = 0 00000004:00010000:3.0:1788940744.211865:0:9713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4a2a042 reply state 00000000b7fa0ac3 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badde2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.211883:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badde2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.211892:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91d0421d1300) 00010000:00010000:3.0:1788940744.211895:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788940744.211901:0:9713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940744.212058:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+66:12423:x1875839921774592:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 760us (8494us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788940744.212081:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 193 00000100:00100000:1.0:1788940744.221893:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940744.221946:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921774720 00000100:00100000:1.0:1788940744.221961:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921774720 00000100:00100000:1.0:1788940744.222026:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 194 00000100:00100000:1.0:1788940744.222039:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+66:12423:x1875839921774720:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940744.222071:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940744.222099:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badde36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc74f2 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.222190:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badde36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74f2 expref: 67 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.222210:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badde36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74f2 expref: 67 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.222236:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91d0421d1300) 00010000:00010000:1.0:1788940744.222240:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940744.222246:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603000, rc 0) 00000100:00100000:1.0:1788940744.225557:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+67:12423:x1875839921774720:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1621us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940744.225578:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 194 00000100:00100000:0.0:1788940744.245733:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940744.245815:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921774848 00000100:00100000:1.0:1788940744.245851:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921774848 00000100:00100000:1.0:1788940744.245956:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:1.0:1788940744.245969:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921774848:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788940744.246165:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940744.246397:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+7:2404:x1875839921774848:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 428us (691us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788940744.246406:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:0.0:1788940744.251171:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940744.258096:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921775104 00000100:00100000:3.0:1788940744.258124:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921775104 00000100:00100000:3.0:1788940744.258220:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 49 00000100:00100000:3.0:1788940744.258233:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+67:12423:x1875839921775104:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788940744.258625:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+68:12423:x1875839921775104:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 392us (7465us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788940744.258634:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 49 00000100:00100000:0.0:1788940744.272713:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940744.272823:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921775360 00000100:00100000:1.0:1788940744.272837:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921775360 00000100:00100000:1.0:1788940744.272918:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 195 00000100:00100000:1.0:1788940744.272931:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+68:12423:x1875839921775360:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788940744.273088:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+68:12423:x1875839921775360:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 158us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940744.273096:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 195 00000100:00100000:1.0:1788940744.277681:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940744.277790:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921775488 00000100:00100000:3.0:1788940744.277806:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921775488 00000100:00100000:3.0:1788940744.277892:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 196 00000100:00100000:3.0:1788940744.277903:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+68:12423:x1875839921775488:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940744.277931:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940744.277960:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badde3d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc74f9 expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.278049:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badde44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.278067:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badde44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.278080:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badde44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940744.278153:0:9713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940744.278180:0:9713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badde44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.278223:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badde3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74f9 expref: 70 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.278250:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badde44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74f9 expref: 69 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.278292:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91d0421d1300) 00010000:00010000:3.0:1788940744.278295:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788940744.278299:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936600, rc 0) 00000100:00100000:3.0:1788940744.278366:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+69:12423:x1875839921775488:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 465us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940744.278374:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 196 00000100:00100000:0.0:1788940744.288025:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940744.288121:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921775616 00000100:00100000:2.0:1788940744.288136:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921775616 00000100:00100000:2.0:1788940744.288218:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:2.0:1788940744.288231:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921775616:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940744.288380:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940744.288459:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002c57eee/0x9c34acc08badde4b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7500 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940744.288497:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa111c8, blocks: 0x0 00010000:00010000:3.0:1788940744.288526:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=499s v=(0 0) 00010000:00010000:3.0:1788940744.288532:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940744.288545:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002c57eee/0x9c34acc08badde4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7500 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.288566:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000002c57eee/0x9c34acc08badde4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7500 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.288583:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937800, rc 0) 00000100:00100000:3.0:1788940744.288673:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+8:2405:x1875839921775616:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 444us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940744.288693:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:0.0:1788940744.294396:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940744.294511:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921775872 00000100:00100000:2.0:1788940744.294527:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921775872 00000100:00100000:2.0:1788940744.294602:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 197 00000100:00100000:2.0:1788940744.294614:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+69:12423:x1875839921775872:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788940744.294771:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+69:12423:x1875839921775872:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 157us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940744.294780:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 197 00000100:00100000:1.0:1788940744.308899:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940744.309934:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921776000 00000100:00100000:3.0:1788940744.309952:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921776000 00000100:00100000:3.0:1788940744.310035:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 60 00000100:00100000:3.0:1788940744.310049:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+8:12423:x1875839921776000:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940744.310075:0:8524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940744.310100:0:8524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b2ce8ec/0x9c34acc08badde52 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7507 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.310147:0:8524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000002c57eee/0x9c34acc08badde4b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7500 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.310157:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940744.310163:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940744.310169:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b2ce8ec/0x9c34acc08badde52 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7507 expref: 9 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.310217:0:8524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000002c57eee/0x9c34acc08badde4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7500 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.310232:0:8524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000002c57eee/0x9c34acc08badde4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7500 expref: 9 pid: 8438 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940744.310249:0:8524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037885f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8524:1875839944917504:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788940744.310410:0:8524:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06eb3780 going to sleep for 11 seconds 00000100:00100000:3.0:1788940744.313790:0:8524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037885f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8524:1875839944917504:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940744.313844:0:8524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b2ce8ec/0x9c34acc08badde52 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7507 expref: 9 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.313873:0:8524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936800, rc 0) 00000100:00100000:3.0:1788940744.313962:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+9:12423:x1875839921776000:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 3914us (5077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940744.313973:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 60 00000100:00100000:3.0:1788940744.317804:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940744.317914:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921776128 00000100:00100000:1.0:1788940744.317930:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921776128 00010000:00010000:1.0:1788940744.317994:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000002c57eee/0x9c34acc08badde4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7500 expref: 9 pid: 8438 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940744.318051:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 88 00000100:00100000:1.0:1788940744.318063:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+9:2404:x1875839921776128:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940744.318093:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940744.318125:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000002c57eee/0x9c34acc08badde4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7500 expref: 9 pid: 8438 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.318169:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000002c57eee/0x9c34acc08badde4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7500 expref: 9 pid: 8438 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.318200:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002c57eee/0x9c34acc08badde4b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7500 expref: 9 pid: 8438 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.318223:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940744.318228:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940744.318238:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b2ce8ec/0x9c34acc08badde52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7507 expref: 8 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.318250:0:7474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b2ce8ec/0x9c34acc08badde52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7507 expref: 8 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.318345:0:7474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006b2ce8ec/0x9c34acc08badde52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7507 expref: 8 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940744.318363:0:7474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7474:1875839944917632:192.168.202.25@tcp:105: 00000100:00100000:1.0:1788940744.318464:0:7474:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940744.323575:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940744.323623:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921776256 00000100:00100000:1.0:1788940744.323637:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921776256 00002000:00100000:1.0:1788940744.323748:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff91d001378e00 x1875839921776256/t0(0) o4->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:720/0 lens 504/0 e 0 to 0 dl 1788940755 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940744.323780:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91d001378e00 with x1875839921776256 ext(0->8) 00002000:00010000:1.0:1788940744.323788:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d001378e00 00000100:00100000:1.0:1788940744.323826:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:1.0:1788940744.323838:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82f3b232-46da-4a78-8599-45df2ddbced0+9:2405:x1875839921776256:12345-192.168.202.25@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788940744.324929:0:7474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7474:1875839944917632:192.168.202.25@tcp:105: 00010000:00010000:3.0:1788940744.324961:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940744.325043:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+11:2404:x1875839921776128:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 6981us (7255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940744.325055:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 88 00000100:00100000:2.0:1788940744.328761:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82f3b232-46da-4a78-8599-45df2ddbced0+10:2405:x1875839921776256:12345-192.168.202.25@tcp:4:lhsmtool_posix.0 Request processed in 4908us (5187us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788940744.328781:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 4 00002000:00100000:2.0:1788940744.328798:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff91d001378e00 x1875839921776256/t4294967315(0) o4->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:720/0 lens 504/448 e 0 to 0 dl 1788940755 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788940744.328810:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91d001378e00 with x1875839921776256 ext(0->8) 00002000:00010000:2.0:1788940744.328819:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d001378e00 00000100:00100000:1.0:1788940744.341024:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940744.341152:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921776384 00000100:00100000:2.0:1788940744.341166:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921776384 00000100:00100000:2.0:1788940744.341296:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 198 00000100:00100000:2.0:1788940744.341310:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+69:12423:x1875839921776384:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788940744.344652:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:1.0:1788940744.344681:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:1.0:1788940744.344782:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788940744.344805:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91cf08c7fb40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788940744.344812:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91d0358b3900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91cf08c7f300 00000020:00080000:1.0:1788940744.344815:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91d0358b3d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91cf07fdf000 00000100:00100000:3.0:1788940744.345111:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940744.345142:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944917760:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788940744.345296:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940744.345349:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940744.345360:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944917888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788940744.345391:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940744.345424:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944917760 00000100:00100000:3.0:1788940744.345434:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944917760 00000100:00100000:3.0:1788940744.345501:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944917888 00000100:00100000:3.0:1788940744.345504:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944917888 00000100:00100000:3.0:1788940744.345529:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788940744.345550:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875839944917760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788940744.345587:0:8439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:3.0:1788940744.345630:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa111c5, atime: 0x6aa111c5, ctime: 0x6aa111c5, blocks: 0x8 00010000:00010000:3.0:1788940744.345640:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c47496f2/0x9c34acc08badde59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.345662:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=499s v=(0 0) 00010000:00010000:3.0:1788940744.345669:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940744.345678:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c47496f2/0x9c34acc08badde59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.345700:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c47496f2/0x9c34acc08badde59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.345724:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c47496f2/0x9c34acc08badde59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.345733:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c47496f2/0x9c34acc08badde59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.345758:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788940744.345961:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1875839944917760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 410us (704us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788940744.345971:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788940744.345992:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788940744.346002:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944917888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788940744.346123:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788940744.346127:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788940745 00002000:00010000:3.0:1788940744.346129:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788940744.346132:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788940744 -> 1788940745 00002000:00010000:3.0:1788940744.346135:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788940744.346175:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875839944917888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 176us (782us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788940744.346183:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788940744.346213:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940744.346219:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788940744.346241:0:10401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940744.346249:0:10401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c47496f2/0x9c34acc08badde59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.346284:0:10401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936000 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940744.346290:0:10401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c47496f2/0x9c34acc08badde59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.346301:0:10401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c47496f2/0x9c34acc08badde59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.346325:0:10401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c47496f2/0x9c34acc08badde59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.346333:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c47496f2/0x9c34acc08badde59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.346370:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940744.346373:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940744.346375:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788940744.346420:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d037885f80/2, rc 0, transno 4294967316 00000100:00100000:3.0:1788940744.346428:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944917888:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1788940744.346455:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d00137aa00/2, rc 0, transno 4294967308 00000100:00100000:3.0:1788940744.346461:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944917760:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788940744.346728:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08baddbc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346749:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08baddbc0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346755:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08baddbc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346761:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940744.346765:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08baddbc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346771:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08baddbc0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346786:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91d03ed37300) 00010000:00010000:2.0:1788940744.346790:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940744.346795:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08baddbc0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346802:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08baddbc0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346828:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddcc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346835:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddcc3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346841:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddcc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346846:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940744.346856:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddcc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346863:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddcc3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346872:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:2.0:1788940744.346875:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940744.346879:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddcc3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346886:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddcc3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346898:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddce6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346904:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddce6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346910:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddce6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346915:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940744.346919:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddce6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346925:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddce6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346933:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:2.0:1788940744.346935:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940744.346945:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddce6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346951:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddce6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346967:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddd2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346974:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddd2c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346980:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddd2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346986:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940744.346989:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddd2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.346995:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddd2c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.347004:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:2.0:1788940744.347007:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940744.347009:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddd2c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.347014:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddd2c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.347025:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badde2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.347031:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badde2f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.347042:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badde2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.347048:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940744.347051:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badde2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.347058:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badde2f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.347067:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91d0421d1300) 00010000:00010000:2.0:1788940744.347069:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788940744.347073:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badde2f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.347079:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08badde2f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788940744.347101:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788940744.347163:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788940744.347367:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+19:12423:x1875839921776384:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 Request processed in 6056us (6357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940744.347377:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 198 00000100:00100000:1.0:1788940744.348034:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940744.348056:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944918016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788940744.348124:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940744.349741:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944918016 00000100:00100000:2.0:1788940744.349758:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944918016 00000100:00100000:2.0:1788940744.349841:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788940744.349853:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944918016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788940744.349897:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788940744.349989:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944918016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 138us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940744.350014:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1788940744.350049:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940744.350099:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944918016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940744.350872:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940744.350890:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944918144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940744.350954:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788940744.351592:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788940744.353639:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944918272:0@lo:400:kworker.0 00000100:00100000:3.0:1788940744.353778:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940744.353853:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944918784:0@lo:400:kworker.0 00000100:00100000:3.0:1788940744.353896:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940744.353921:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944919296:0@lo:400:kworker.0 00000100:00100000:3.0:1788940744.353960:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940744.354005:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788940744.354013:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944918656:0@lo:400:kworker.0 00000100:00100000:3.0:1788940744.354038:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940744.354056:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944919168:0@lo:400:kworker.0 00000100:00100000:3.0:1788940744.354083:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940744.354125:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944919296 00000100:00100000:3.0:1788940744.354135:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944919296 00000100:00100000:3.0:1788940744.354203:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944918656 00000100:00100000:3.0:1788940744.354227:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944918656 00000100:00100000:0.0:1788940744.354412:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944918272 00000100:00100000:0.0:1788940744.354417:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944918272 00000100:00100000:0.0:1788940744.354461:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1788940744.354471:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944918272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940744.354560:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944918272:12345-0@lo:400:kworker.0 Request processed in 73us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940744.354567:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1788940744.355509:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944918144 00000100:00100000:2.0:1788940744.355519:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944918144 00000100:00100000:2.0:1788940744.355574:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788940744.355583:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875839944918144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940744.355608:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788940744.355667:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875839944918144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (4714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940744.355674:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:2.0:1788940744.355716:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940744.355749:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944918400:0@lo:400:kworker.0 00000100:00100000:2.0:1788940744.355787:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940744.355830:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944918912:0@lo:400:kworker.0 00000100:00100000:2.0:1788940744.355854:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940744.355878:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944919424:0@lo:400:kworker.0 00000100:00100000:2.0:1788940744.355901:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940744.355918:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788940744.355925:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944918528:0@lo:400:kworker.0 00000100:00100000:2.0:1788940744.355953:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940744.355974:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944919040:0@lo:400:kworker.0 00000100:00100000:2.0:1788940744.355995:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940744.356016:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944918784 00000100:00100000:2.0:1788940744.356021:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944918784 00000100:00100000:2.0:1788940744.356068:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944918528 00000100:00100000:2.0:1788940744.356072:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944918528 00000100:00100000:2.0:1788940744.356089:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788940744.356095:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944918784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940744.356135:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944918784:12345-0@lo:400:kworker.0 Request processed in 41us (2240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940744.356142:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788940744.356155:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788940744.356161:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944918528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940744.356196:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944918528:12345-0@lo:400:kworker.0 Request processed in 36us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940744.356202:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788940744.356226:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944918400 00000100:00100000:2.0:1788940744.356229:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944918400 00000100:00100000:3.0:1788940744.358175:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944918912 00000100:00100000:3.0:1788940744.358191:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944918912 00000100:00100000:3.0:1788940744.358250:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944919424 00000100:00100000:2.0:1788940744.358561:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944919040 00000100:00100000:2.0:1788940744.358567:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944919040 00000100:00100000:2.0:1788940744.358595:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788940744.358607:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944919296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940744.358741:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944919296:12345-0@lo:400:kworker.0 Request processed in 137us (4779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940744.358751:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788940744.358773:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1788940744.358780:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944918656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940744.358817:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944918656:12345-0@lo:400:kworker.0 Request processed in 38us (4778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940744.358823:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1788940744.358835:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1788940744.358854:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944918912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940744.358886:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944918912:12345-0@lo:400:kworker.0 Request processed in 34us (3032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940744.358893:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1788940744.358905:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1788940744.358910:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944918400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940744.358939:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944918400:12345-0@lo:400:kworker.0 Request processed in 28us (3151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940744.358945:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1788940744.358958:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1788940744.358964:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0854b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944919040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940744.358991:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0854b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944919040:12345-0@lo:400:kworker.0 Request processed in 28us (2995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940744.358999:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00080000:2.0:1788940744.359026:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940744.359031:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940744.359096:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944918528:0@lo:400:kworker.0 00010000:00080000:2.0:1788940744.359116:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08d71f80 x1875839944919040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940744.359127:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944919040:0@lo:400:kworker.0 00000100:00100000:3.0:1788940744.359836:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944919424 00000100:00100000:3.0:1788940744.359912:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788940744.359921:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944919424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940744.360008:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944918400:0@lo:400:kworker.0 00000100:00080000:1.0:1788940744.360069:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788940744.368663:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940744.372019:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944919168 00000100:00100000:1.0:1788940744.372043:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944919168 00000100:00100000:1.0:1788940744.372156:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921776512 00000100:00100000:1.0:1788940744.372160:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921776512 00000100:00100000:1.0:1788940744.372194:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788940744.372208:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944919168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940744.372378:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944919168:12345-0@lo:400:kworker.0 Request processed in 171us (18292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940744.372387:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788940744.372430:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 63 00000100:00100000:1.0:1788940744.372438:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+10:2405:x1875839921776512:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 00000100:00080000:0.0:1788940744.373210:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940744.373460:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944918656:0@lo:400:kworker.0 00000100:00100000:0.0:1788940744.373479:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944919168:0@lo:400:kworker.0 00000100:00100000:0.0:1788940744.373492:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944918272:0@lo:400:kworker.0 00000100:00100000:0.0:1788940744.373507:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944918784:0@lo:400:kworker.0 00000100:00100000:0.0:1788940744.373520:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944919296:0@lo:400:kworker.0 00000100:00100000:0.0:1788940744.373562:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944918144:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788940744.379735:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1788940744.379756:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1788940744.379996:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921776512:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 Request processed in 7549us (11344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940744.380011:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 63 00000100:00100000:3.0:1788940744.382643:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944919424:12345-0@lo:400:kworker.0 Request processed in 22709us (26725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940744.382661:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1788940744.383064:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944918912:0@lo:400:kworker.0 00010000:00080000:2.0:1788940744.383206:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08d71880 x1875839944919424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940744.383389:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944919424:0@lo:400:kworker.0 00000100:00100000:1.0:1788940744.385899:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940744.387547:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921776768 00000100:00100000:2.0:1788940744.387564:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921776768 00000100:00100000:2.0:1788940744.387648:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 199 00000100:00100000:2.0:1788940744.387668:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+19:12423:x1875839921776768:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788940744.387755:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940744.387794:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08badde44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74f9 expref: 19 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.387818:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91d0421d1300) 00010000:00010000:2.0:1788940744.387825:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940744.387866:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badde60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.387886:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badde60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.387899:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badde60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940744.388076:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0b484c5 reply state 00000000161df5f3 transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badde60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.388090:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badde60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.388097:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91d0421d1300) 00010000:00010000:2.0:1788940744.388100:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788940744.388117:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940744.388285:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+20:12423:x1875839921776768:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 600us (2375us total) trans 4294967464 rc 0/0 00000100:00100000:2.0:1788940744.388293:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 199 00000100:00100000:0.0:1788940744.397772:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940744.404627:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921776896 00000100:00100000:3.0:1788940744.404645:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921776896 00000100:00100000:3.0:1788940744.404743:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:3.0:1788940744.404759:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921776896:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788940744.405018:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788940744.405023:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788940745 -> 1788940743 00002000:00010000:3.0:1788940744.405025:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788940741 00002000:00010000:3.0:1788940744.405028:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788940745 -> 1788940743 00002000:00010000:3.0:1788940744.405030:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788940744.405175:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+8:2405:x1875839921776896:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 418us (7517us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788940744.405184:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:0.0:1788940744.433332:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940744.433494:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921777152 00000100:00100000:1.0:1788940744.433510:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921777152 00000100:00100000:1.0:1788940744.433604:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 200 00000100:00100000:1.0:1788940744.433625:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+20:12423:x1875839921777152:12345-192.168.202.25@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788940744.433737:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.433761:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde28 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74eb expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.433773:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde67 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.433823:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74eb expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.433841:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74eb expref: 20 pid: 6520 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940744.433859:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0359d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944919552:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940744.433976:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940744.446130:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940744.446645:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0359d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944919552:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940744.446716:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940744.446941:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921777280 00000100:00100000:3.0:1788940744.446954:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921777280 00010000:00010000:3.0:1788940744.447005:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74eb expref: 21 pid: 6520 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940744.447057:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 89 00000100:00100000:3.0:1788940744.447090:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+21:2405:x1875839921777280:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940744.447110:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940744.447119:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74eb expref: 21 pid: 6520 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.447133:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74eb expref: 21 pid: 6520 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.447162:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08badde28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74eb expref: 21 pid: 6520 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.447183:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91d0421d1300) 00010000:00010000:3.0:1788940744.447189:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.447201:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.447210:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde67 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.447367:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940744.447448:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+20:2405:x1875839921777280:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 370us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940744.447457:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 89 00010000:00010000:1.0:1788940744.447917:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.447927:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.447984:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.447992:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde67 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.447999:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.448005:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940744.448010:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.448019:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde67 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.448032:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91d0421d1300) 00010000:00010000:1.0:1788940744.448035:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788940744.448041:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde67 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.448048:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde67 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940744.448146:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+19:12423:x1875839921777152:12345-192.168.202.25@tcp:55:lhsmtool_posix.0 Request processed in 14523us (14831us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788940744.448155:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 200 00000100:00100000:1.0:1788940744.465546:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940744.465641:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921777408 00000100:00100000:0.0:1788940744.465655:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921777408 00000100:00100000:0.0:1788940744.465744:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:0.0:1788940744.465758:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0359d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+8:2407:x1875839921777408:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788940744.465824:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e066b587/0x9c34acc08badde6e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.465855:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b2ce8ec/0x9c34acc08badde52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7507 expref: 8 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.465866:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940744.465871:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940744.465877:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e066b587/0x9c34acc08badde6e lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.465924:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b2ce8ec/0x9c34acc08badde52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7507 expref: 8 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.465942:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b2ce8ec/0x9c34acc08badde52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7507 expref: 8 pid: 8524 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940744.465974:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8439:1875839944919680:192.168.202.25@tcp:104: 00000100:00100000:0.0:1788940744.466188:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08715840 going to sleep for 11 seconds 00000100:00100000:3.0:1788940744.475883:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940744.482333:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8439:1875839944919680:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940744.482381:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e066b587/0x9c34acc08badde6e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940744.483025:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921777536 00000100:00100000:3.0:1788940744.483037:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921777536 00010000:00010000:3.0:1788940744.485657:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b2ce8ec/0x9c34acc08badde52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7507 expref: 9 pid: 8524 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940744.485781:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 90 00000100:00100000:3.0:1788940744.485802:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+9:2404:x1875839921777536:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940744.485824:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940744.485854:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b2ce8ec/0x9c34acc08badde52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7507 expref: 9 pid: 8524 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.485871:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b2ce8ec/0x9c34acc08badde52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7507 expref: 9 pid: 8524 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.485904:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b2ce8ec/0x9c34acc08badde52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7507 expref: 9 pid: 8524 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.485925:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940744.485931:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940744.485938:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e066b587/0x9c34acc08badde6e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.485950:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e066b587/0x9c34acc08badde6e lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.485987:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940744.486066:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+8:2404:x1875839921777536:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 274us (10197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940744.486074:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 90 00010000:00010000:1.0:1788940744.487690:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e066b587/0x9c34acc08badde6e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.487715:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e066b587/0x9c34acc08badde6e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.487761:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e066b587/0x9c34acc08badde6e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.487771:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e066b587/0x9c34acc08badde6e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.487780:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e066b587/0x9c34acc08badde6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.487788:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031000 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940744.487794:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e066b587/0x9c34acc08badde6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.487817:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e066b587/0x9c34acc08badde6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.487839:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e066b587/0x9c34acc08badde6e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.487847:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e066b587/0x9c34acc08badde6e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940744.487959:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0359d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+8:2407:x1875839921777408:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 Request processed in 22200us (22423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940744.487970:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:3.0:1788940744.496360:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940744.496658:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921777792 00000100:00100000:1.0:1788940744.496673:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921777792 00000100:00100000:1.0:1788940744.496772:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 201 00000100:00100000:1.0:1788940744.496785:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+19:12423:x1875839921777792:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788940744.496902:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badde75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.496923:0:8517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddcbc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7490 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.496935:0:8517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badde75 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.497001:0:8517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddcbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7490 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.497027:0:8517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddcbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7490 expref: 19 pid: 6521 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940744.497046:0:8517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944919808:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940744.497163:0:8517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940744.502314:0:8517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944919808:192.168.202.25@tcp:104: 00010000:00010000:2.0:1788940744.502360:0:8517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badde75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940744.505799:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940744.506096:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921777920 00000100:00100000:2.0:1788940744.506110:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921777920 00010000:00010000:2.0:1788940744.506168:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddcbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7490 expref: 20 pid: 6521 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940744.506217:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 91 00000100:00100000:2.0:1788940744.506231:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+20:2405:x1875839921777920:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940744.506249:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940744.506293:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddcbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7490 expref: 20 pid: 6521 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.506310:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddcbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7490 expref: 20 pid: 6521 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.506339:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08baddcbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7490 expref: 20 pid: 6521 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.506359:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:2.0:1788940744.506367:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badde75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.506400:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badde75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.506409:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badde75 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940744.506447:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940744.506528:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+19:2405:x1875839921777920:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 298us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940744.506537:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 91 00010000:00010000:1.0:1788940744.506880:0:8517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badde75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.506891:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badde75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.507138:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.507153:0:8517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badde36 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74f2 expref: 19 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.507163:0:8517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde7c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.507203:0:8517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badde36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74f2 expref: 19 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.507219:0:8517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badde36 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74f2 expref: 19 pid: 8517 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940744.507239:0:8517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944919936:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940744.507383:0:8517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940744.518675:0:8517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944919936:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940744.518732:0:8517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940744.518899:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940744.519219:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921778048 00000100:00100000:3.0:1788940744.519229:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921778048 00010000:00010000:3.0:1788940744.519336:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badde36 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74f2 expref: 20 pid: 8517 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940744.519381:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 92 00000100:00100000:3.0:1788940744.519394:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07f71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+20:2404:x1875839921778048:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940744.519413:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940744.519421:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badde36 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74f2 expref: 20 pid: 8517 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.519436:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badde36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74f2 expref: 20 pid: 8517 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.519468:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badde36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74f2 expref: 20 pid: 8517 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.519489:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91d0421d1300) 00010000:00010000:3.0:1788940744.519495:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.519507:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.519535:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde7c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.519568:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940744.519639:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07f71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+19:2404:x1875839921778048:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 247us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940744.519647:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 92 00010000:00010000:1.0:1788940744.520006:0:8517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.520016:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788940744.520174:0:8517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1788940744.520379:0:8517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:1.0:1788940744.520424:0:8517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1788940744.520531:0:8517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8517:1875839944920064:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788940744.520600:0:8517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940744.520631:0:8517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30600 going to sleep for 11 seconds 00000100:00100000:2.0:1788940744.521033:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944920064 00000100:00100000:2.0:1788940744.521043:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944920064 00000100:00100000:2.0:1788940744.521200:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788940744.521211:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8517:x1875839944920064:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788940744.521364:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8517:x1875839944920064:12345-0@lo:1000:mdt00_003.0 Request processed in 156us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940744.521373:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788940744.521932:0:8517:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1788940744.521939:0:8517:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d037885f80, transno 4294967316 00000100:00100000:1.0:1788940744.521962:0:8517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8517:1875839944920064:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788940744.522136:0:8517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:1.0:1788940744.522215:0:8517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8517:1875839944920192:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788940744.522435:0:8517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940744.522466:0:8517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940744.522493:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944920192 00000100:00100000:1.0:1788940744.522499:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944920192 00000100:00100000:1.0:1788940744.522542:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788940744.522551:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8517:x1875839944920192:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788940744.522700:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8517:x1875839944920192:12345-0@lo:1000:mdt00_003.0 Request processed in 150us (265us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788940744.522719:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788940744.522760:0:8517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8517:1875839944920192:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788940744.522827:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.522840:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde7c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.522848:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde7c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.522855:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940744.522861:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde7c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.522871:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde7c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.522893:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91d0421d1300) 00010000:00010000:1.0:1788940744.522897:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940744.522903:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde7c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.522912:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badde7c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.522946:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badddb1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.522953:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badddb1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.522959:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badddb1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.522976:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940744.522979:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badddb1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.522986:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badddb1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.522997:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:1.0:1788940744.522999:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940744.523003:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badddb1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.523010:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08badddb1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.523038:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badde83 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.523056:0:8517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badddcd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74d6 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.523067:0:8517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badde83 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.523099:0:8517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badddcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74d6 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.523115:0:8517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badddcd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74d6 expref: 22 pid: 6521 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940744.523144:0:8517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944920320:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940744.523223:0:8517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940744.528798:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940744.528877:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921778176 00000100:00100000:3.0:1788940744.528892:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921778176 00010000:00010000:3.0:1788940744.528949:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badddcd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74d6 expref: 23 pid: 6521 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940744.529001:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 93 00000100:00100000:3.0:1788940744.529012:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+23:2405:x1875839921778176:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940744.529030:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940744.529038:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badddcd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74d6 expref: 23 pid: 6521 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.529054:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badddcd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74d6 expref: 23 pid: 6521 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.529083:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:3.0:1788940744.529090:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badde83 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.529102:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badde83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.529128:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badde83 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.529153:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940744.529235:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+23:2405:x1875839921778176:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 222us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940744.529243:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 93 00010000:00010000:1.0:1788940744.529508:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08badddcd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc74d6 expref: 22 pid: 6521 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940744.529530:0:8517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944920320:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940744.529557:0:8517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badde83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.529569:0:8517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badde83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.529576:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badde83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.529592:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badde83 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.529600:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badde83 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.529607:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badde83 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.529613:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940744.529619:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badde83 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.529628:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badde83 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.529646:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:1.0:1788940744.529649:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940744.529654:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badde83 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.529660:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badde83 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.529675:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badde75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.529681:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badde75 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.529687:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badde75 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.529692:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940744.529695:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badde75 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.529701:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badde75 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.529717:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfa300) 00010000:00010000:1.0:1788940744.529720:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788940744.529723:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badde75 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.529729:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badde75 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940744.529945:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+21:12423:x1875839921777792:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 33161us (33600us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788940744.529955:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 201 00000020:00080000:1.0:1788940744.529960:0:8517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788940744.530622:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940744.530629:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940744.531127:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788940744.531139:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788940744.536361:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940744.537107:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921778432 00000100:00100000:0.0:1788940744.537125:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921778432 00000100:00100000:0.0:1788940744.537207:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 50 00000100:00100000:0.0:1788940744.537220:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d002e66c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+21:12423:x1875839921778432:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788940744.540743:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788940744.540804:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:0.0:1788940744.540855:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badde8a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.540879:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badde8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.540896:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badde8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.540907:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badde8a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.540915:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badde8a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.540923:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badde8a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940744.541395:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788940744.541596:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d002e66c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+23:12423:x1875839921778432:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 4370us (5248us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788940744.541633:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 50 00000020:00080000:0.0:1788940744.541641:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788940744.549736:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940744.549757:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badde8a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.549773:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031000 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940744.549778:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badde8a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.549791:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badde8a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.549815:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91d0421d1300) 00010000:00010000:1.0:1788940744.549820:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788940744.549827:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badde8a lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.549834:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08badde8a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.549848:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940744.549849:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940744.549851:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788940744.664592:0:14664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940744.664607:0:14664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940744.664643:0:14664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788940744.664654:0:14664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788940744.867201:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940744.867951:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921778688 00000100:00100000:3.0:1788940744.868027:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921778688 00000100:00100000:3.0:1788940744.868172:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 202 00000100:00100000:3.0:1788940744.868188:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0313ac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+23:12433:x1875839921778688:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940744.868230:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940744.868323:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badde91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc750e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.868517:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badde98 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.868537:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badde98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.868582:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badde98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940744.868599:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788940744.868793:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badde91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc750e expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.868830:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badde98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc750e expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940744.868842:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:3.0:1788940744.868846:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788940744.868851:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936000, rc 0) 00000100:00100000:3.0:1788940744.868945:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0313ac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+25:12433:x1875839921778688:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 761us (1763us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788940744.868953:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 202 00000100:00100000:3.0:1788940744.882175:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940744.882391:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921778816 00000100:00100000:1.0:1788940744.882408:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921778816 00000100:00100000:1.0:1788940744.882495:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 203 00000100:00100000:1.0:1788940744.882510:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+25:12433:x1875839921778816:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:1.0:1788940744.882648:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddea6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.882674:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddea6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.882693:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddea6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.882723:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddead lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.882732:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddead lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.882739:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddead lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.882899:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddeb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.882907:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddeb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.882914:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddeb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940744.882989:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddeb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883005:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddea6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883023:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddea6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883030:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddea6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883037:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940744.883043:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddea6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883052:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddea6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883066:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:1.0:1788940744.883070:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940744.883077:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddea6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883084:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddea6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883100:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddead lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883107:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddead lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883113:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddead lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883118:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940744.883128:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddead lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883134:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddead lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883143:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91cf06dfbe00) 00010000:00010000:1.0:1788940744.883145:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940744.883148:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddead lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883154:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddead lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883172:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddeb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883178:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddeb4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883184:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddeb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883188:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940744.883191:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddeb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883197:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddeb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883204:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfbf00) 00010000:00010000:1.0:1788940744.883206:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940744.883216:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddeb4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940744.883222:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddeb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940744.883381:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+25:12433:x1875839921778816:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 872us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940744.883391:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 203 00010000:00010000:3.0:1788940744.989513:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940745.027069:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940745.027222:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921779072 00000100:00100000:1.0:1788940745.027237:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921779072 00000100:00100000:1.0:1788940745.027368:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 204 00000100:00100000:1.0:1788940745.027381:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+25:12436:x1875839921779072:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788940745.027414:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940745.027444:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddebb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7515 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.027549:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddec2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.027569:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddec2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.027584:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddec2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.027600:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddec9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.027607:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.027640:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.027799:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badded0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.027809:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badded0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.027816:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badded0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940745.027828:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788940745.027935:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddec2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.027943:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddec2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.027950:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddec2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.027958:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940745.028838:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddec2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.028863:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddec2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.028881:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:1.0:1788940745.028884:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940745.028908:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddec2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.028916:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddec2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.028939:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddec9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.028947:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddec9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.028954:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddec9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.028960:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940745.028963:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddec9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.029141:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddec9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.029150:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91cf06dfbf00) 00010000:00010000:1.0:1788940745.029152:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940745.029156:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddec9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.029162:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddec9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.029238:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08baddebb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7515 expref: 28 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.029361:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badded0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7515 expref: 27 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.029369:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfbe00) 00010000:00010000:1.0:1788940745.029372:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940745.029375:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602600, rc 0) 00000100:00100000:1.0:1788940745.029475:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+27:12436:x1875839921779072:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 2095us (2421us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1788940745.029485:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 204 00000100:00100000:1.0:1788940745.046208:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940745.046387:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921779200 00000100:00100000:3.0:1788940745.046402:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921779200 00000100:00100000:3.0:1788940745.046500:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 205 00000100:00100000:3.0:1788940745.046513:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+27:12436:x1875839921779200:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:3.0:1788940745.046607:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddede lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.046629:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.047147:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.047210:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.047220:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddede lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.047228:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddede lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.047235:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940745.047241:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddede lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.047251:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddede lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.047475:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfbe00) 00010000:00010000:3.0:1788940745.047479:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788940745.047486:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddede lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.047493:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddede lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940745.048414:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+27:12436:x1875839921779200:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 1892us (2211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940745.048439:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 205 00000100:00100000:3.0:1788940745.053536:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940745.053738:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921779456 00000100:00100000:1.0:1788940745.053755:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921779456 00000100:00100000:1.0:1788940745.053837:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:1.0:1788940745.053852:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+27:12436:x1875839921779456:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:1.0:1788940745.054171:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+28:12436:x1875839921779456:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 321us (649us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1788940745.054180:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:2.0:1788940745.114885:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940745.115038:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921779712 00000100:00100000:3.0:1788940745.115054:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921779712 00000100:00100000:3.0:1788940745.115144:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 206 00000100:00100000:3.0:1788940745.115158:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+28:11969:x1875839921779712:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1788940745.115195:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940745.115225:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddee5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc751c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.115446:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddeec lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.115468:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badded0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7515 expref: 29 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.115478:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddeec lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.115525:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badded0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7515 expref: 29 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.115542:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badded0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7515 expref: 29 pid: 8517 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940745.115559:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875839944920448:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788940745.115693:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788940745.120144:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940745.120314:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921779840 00000100:00100000:1.0:1788940745.120328:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921779840 00010000:00010000:1.0:1788940745.120389:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badded0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7515 expref: 30 pid: 8517 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940745.120447:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 94 00000100:00100000:1.0:1788940745.120459:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037885880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+30:2405:x1875839921779840:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940745.120476:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940745.120503:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badded0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7515 expref: 30 pid: 8517 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.120518:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badded0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7515 expref: 30 pid: 8517 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.120546:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfbe00) 00010000:00010000:1.0:1788940745.120553:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddeec lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.120565:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddeec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.120574:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddeec lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.120600:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940745.120666:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037885880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+30:2405:x1875839921779840:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 208us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940745.120675:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 94 00010000:00010000:3.0:1788940745.122131:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badded0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7515 expref: 29 pid: 8517 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940745.122162:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875839944920448:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940745.122209:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddeec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.122220:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddeec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.122227:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddeec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940745.122571:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788940745.123155:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddee5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc751c expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.123181:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddeec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc751c expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.123190:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfbe00) 00010000:00010000:3.0:1788940745.123194:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788940745.123198:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937200, rc 0) 00000100:00100000:3.0:1788940745.127215:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+29:11969:x1875839921779712:12345-192.168.202.25@tcp:101:bash.0 Request processed in 12039us (12324us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788940745.127235:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 206 00000100:00100000:2.0:1788940745.131349:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940745.131597:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921779968 00000100:00100000:1.0:1788940745.131612:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921779968 00000100:00100000:1.0:1788940745.131689:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 207 00000100:00100000:1.0:1788940745.131713:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+29:11969:x1875839921779968:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:1.0:1788940745.131956:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940745.131988:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddefa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7523 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.132033:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddf01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.132066:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddf01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.132080:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddf01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.132227:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddefa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7523 expref: 31 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.132252:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddf01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7523 expref: 30 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.132356:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfbe00) 00010000:00010000:1.0:1788940745.132359:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788940745.132364:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603600, rc 0) 00000100:00100000:1.0:1788940745.132496:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+30:11969:x1875839921779968:12345-192.168.202.25@tcp:101:bash.0 Request processed in 795us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940745.132505:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 207 00000100:00100000:0.0:1788940745.146157:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940745.147416:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921780224 00000100:00100000:3.0:1788940745.147446:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921780224 00000100:00100000:3.0:1788940745.147546:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 208 00000100:00100000:3.0:1788940745.147559:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+30:11969:x1875839921780224:12345-192.168.202.25@tcp:36:bash.0 00010000:00010000:3.0:1788940745.148049:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddf08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.148099:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddf08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.148116:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddf08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940745.148173:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:3.0:1788940745.148200:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006672f8f6 reply state 00000000b7fa0ac3 transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddf08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.148214:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddf08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.148223:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfbe00) 00010000:00010000:3.0:1788940745.148227:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788940745.148232:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788940745.148331:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:3.0:1788940745.148466:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+34:11969:x1875839921780224:12345-192.168.202.25@tcp:36:bash.0 Request processed in 907us (2323us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788940745.148475:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 208 00000020:00080000:3.0:1788940745.148481:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788940745.158181:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940745.158886:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921780352 00000100:00100000:3.0:1788940745.158903:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921780352 00000100:00100000:3.0:1788940745.158988:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 209 00000100:00100000:3.0:1788940745.159001:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+34:11969:x1875839921780352:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1788940745.159034:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940745.159062:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddf0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc752a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.159167:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddf0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc752a expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.159185:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddf0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc752a expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.159206:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfbe00) 00010000:00010000:3.0:1788940745.159210:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940745.159215:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937a00, rc 0) 00000100:00100000:3.0:1788940745.159437:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+35:11969:x1875839921780352:12345-192.168.202.25@tcp:101:bash.0 Request processed in 438us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940745.159446:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 209 00000100:00100000:2.0:1788940745.162875:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940745.163048:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921780480 00000100:00100000:3.0:1788940745.163062:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921780480 00000100:00100000:3.0:1788940745.163140:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:3.0:1788940745.163153:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:11969:x1875839921780480:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1788940745.163178:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940745.163209:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08baddf16 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7531 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940745.163245:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa111c7, atime: 0x6aa111c5, ctime: 0x6aa111c7, blocks: 0x8 00010000:00010000:3.0:1788940745.163328:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788940745.163334:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940745.163346:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08baddf16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7531 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.163391:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08baddf16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7531 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.163408:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936200, rc 0) 00000100:00100000:3.0:1788940745.163619:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+8:11969:x1875839921780480:12345-192.168.202.25@tcp:101:bash.0 Request processed in 467us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940745.163627:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:0.0:1788940745.166812:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940745.167296:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921780608 00000100:00100000:2.0:1788940745.167311:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921780608 00002000:00010000:2.0:1788940745.167367:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1788940745.167374:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91cf08d70700 with x1875839921780608 ext(0->18446744073709551615) 00002000:00010000:2.0:1788940745.167406:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91cf08d70700. 00000100:00100000:2.0:1788940745.167460:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:2.0:1788940745.167472:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82f3b232-46da-4a78-8599-45df2ddbced0+8:2404:x1875839921780608:12345-192.168.202.25@tcp:10:bash.0 00002000:00010000:2.0:1788940745.167962:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788940745.167967:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788940743 -> 1788940745 00002000:00010000:2.0:1788940745.167970:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788940741 -> 1788940741 00002000:00010000:2.0:1788940745.167973:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788940743 -> 1788940745 00002000:00010000:2.0:1788940745.167975:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788940745.168053:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82f3b232-46da-4a78-8599-45df2ddbced0+9:2404:x1875839921780608:12345-192.168.202.25@tcp:10:bash.0 Request processed in 582us (1255us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788940745.168062:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 5 00002000:00010000:2.0:1788940745.168066:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1788940745.168069:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91cf08d70700 with x1875839921780608 ext(0->18446744073709551615) 00002000:00010000:2.0:1788940745.168074:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91cf08d70700. 00000100:00100000:2.0:1788940745.310244:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940745.310470:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921780736 00000100:00100000:1.0:1788940745.310484:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921780736 00000100:00100000:1.0:1788940745.310566:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 210 00000100:00100000:1.0:1788940745.310579:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+35:12450:x1875839921780736:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:1.0:1788940745.310684:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddf1d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.310719:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddf1d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.310769:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddf1d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.310790:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddf24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.310798:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddf24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.310804:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddf24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.310906:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08baddf2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.310916:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08baddf2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.310923:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08baddf2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940745.310984:0:8517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08baddf2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.310997:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddf1d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311005:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddf1d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311012:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddf1d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311030:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940745.311035:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddf1d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311045:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddf1d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311059:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:1.0:1788940745.311063:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940745.311070:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddf1d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311076:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08baddf1d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311095:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddf24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311102:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddf24 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311107:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddf24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311113:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940745.311115:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddf24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311121:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddf24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311140:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91cf06dfbf00) 00010000:00010000:1.0:1788940745.311143:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940745.311146:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddf24 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311152:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602e00/0x9c34acc08baddf24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311170:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08baddf2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311177:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08baddf2b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311182:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08baddf2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311188:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940745.311191:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08baddf2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311197:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08baddf2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311204:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfbe00) 00010000:00010000:1.0:1788940745.311207:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940745.311210:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08baddf2b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.311215:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08baddf2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940745.311545:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+35:12450:x1875839921780736:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 965us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940745.311556:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 210 00000100:00100000:0.0:1788940745.372312:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940745.372467:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921780992 00000100:00100000:3.0:1788940745.372481:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921780992 00000100:00100000:3.0:1788940745.372569:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 211 00000100:00100000:3.0:1788940745.372583:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+35:12453:x1875839921780992:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940745.372617:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940745.372646:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7538 expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.372762:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddf39 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.372782:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddf39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.372796:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddf39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.372813:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.372843:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.372850:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373003:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddf47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373014:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddf47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373022:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddf47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940745.373034:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788940745.373141:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddf39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373151:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddf39 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373158:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddf39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373165:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940745.373170:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddf39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373179:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddf39 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373203:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:3.0:1788940745.373206:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940745.373213:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddf39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373220:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddf39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373237:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373244:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373249:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373612:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940745.373617:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373626:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373636:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91cf07e65e00) 00010000:00010000:3.0:1788940745.373638:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940745.373642:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf40 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373648:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373765:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7538 expref: 38 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373782:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddf47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7538 expref: 37 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.373790:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfbe00) 00010000:00010000:3.0:1788940745.373793:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788940745.373796:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936e00, rc 0) 00000100:00100000:3.0:1788940745.373893:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+37:12453:x1875839921780992:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 1312us (1646us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788940745.373903:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 211 00000100:00100000:2.0:1788940745.378467:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940745.378573:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921781120 00000100:00100000:3.0:1788940745.378587:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921781120 00000100:00100000:3.0:1788940745.378671:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 212 00000100:00100000:3.0:1788940745.378684:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+37:12453:x1875839921781120:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:3.0:1788940745.378805:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.378828:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddeec lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc751c expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.378840:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf55 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.378886:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddeec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc751c expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.378927:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddeec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc751c expref: 37 pid: 6521 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940745.378944:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875839944920576:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788940745.379088:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940745.384107:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940745.384217:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921781376 00000100:00100000:1.0:1788940745.384231:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921781376 00000100:00100000:1.0:1788940745.384343:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:1.0:1788940745.384356:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+38:6659:x1875839921781376:12345-192.168.202.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788940745.384777:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+39:6659:x1875839921781376:12345-192.168.202.25@tcp:35:ldlm_bl.0 Request processed in 422us (687us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788940745.384786:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:3.0:1788940745.385818:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875839944920576:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940745.385865:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940745.391676:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940745.391852:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921781504 00000100:00100000:3.0:1788940745.391866:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921781504 00010000:00010000:3.0:1788940745.391924:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddeec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc751c expref: 39 pid: 6521 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940745.392053:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 95 00000100:00100000:3.0:1788940745.392065:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050d9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+39:2406:x1875839921781504:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940745.392086:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940745.392094:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddeec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc751c expref: 39 pid: 6521 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.392110:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddeec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc751c expref: 39 pid: 6521 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.392138:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddeec lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc751c expref: 39 pid: 6521 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.392183:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfbe00) 00010000:00010000:3.0:1788940745.392189:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.392201:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.392210:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf55 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940745.392504:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940745.392517:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940745.392573:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940745.392581:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940745.392589:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940745.392596:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940745.392601:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940745.392610:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940745.392620:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfbe00) 00010000:00010000:0.0:1788940745.392623:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940745.392638:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf55 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940745.392645:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.393417:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940745.393481:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050d9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+38:2406:x1875839921781504:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 1412us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940745.393495:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 95 00000100:00100000:0.0:1788940745.393650:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+37:12453:x1875839921781120:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 14968us (15199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940745.393661:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 212 00000100:00100000:2.0:1788940745.402556:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940745.402669:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921781760 00000100:00100000:1.0:1788940745.402684:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921781760 00000100:00100000:1.0:1788940745.402878:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:1.0:1788940745.402892:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+37:12453:x1875839921781760:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:1.0:1788940745.403236:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+38:12453:x1875839921781760:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 346us (694us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788940745.403246:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:2.0:1788940745.511096:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940745.511239:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921782016 00000100:00100000:3.0:1788940745.511253:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921782016 00000100:00100000:3.0:1788940745.511387:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 213 00000100:00100000:3.0:1788940745.511399:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+38:12464:x1875839921782016:12345-192.168.202.25@tcp:101:cat.0 00010000:00010000:3.0:1788940745.511443:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940745.511470:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddf5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc753f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.511567:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf63 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.511586:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.511602:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.511637:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.511645:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.511652:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.511811:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddf71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.511821:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddf71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.511829:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddf71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940745.511841:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788940745.511946:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.511954:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf63 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.511961:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.512154:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940745.512160:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.512180:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf63 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.512194:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:3.0:1788940745.512197:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940745.512204:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.512210:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.512230:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.512237:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.512244:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.512249:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940745.512309:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.512317:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.512324:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91cf07e65e00) 00010000:00010000:3.0:1788940745.512326:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940745.512329:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.512349:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.512404:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddf5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc753f expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.512891:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddf71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc753f expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.512901:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfbe00) 00010000:00010000:3.0:1788940745.512903:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940745.512906:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937c00, rc 0) 00000100:00100000:3.0:1788940745.513122:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+40:12464:x1875839921782016:12345-192.168.202.25@tcp:101:cat.0 Request processed in 1723us (2038us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788940745.513132:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 213 00000100:00100000:2.0:1788940745.517207:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940745.517377:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921782272 00000100:00100000:1.0:1788940745.517393:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921782272 00000100:00100000:1.0:1788940745.517486:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:1.0:1788940745.517500:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+40:12464:x1875839921782272:12345-192.168.202.25@tcp:35:cat.0 00000100:00100000:1.0:1788940745.517922:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+41:12464:x1875839921782272:12345-192.168.202.25@tcp:35:cat.0 Request processed in 425us (730us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788940745.517932:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:2.0:1788940745.536872:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940745.537319:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921782528 00000100:00100000:3.0:1788940745.537333:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921782528 00000100:00100000:3.0:1788940745.537428:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 214 00000100:00100000:3.0:1788940745.537441:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+41:12466:x1875839921782528:12345-192.168.202.25@tcp:36:rm.0 00010000:00010000:3.0:1788940745.537517:0:9713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788940745.537552:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddf0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc752a expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.537578:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddf71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc753f expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.537614:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddf47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7538 expref: 39 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.537628:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08baddf01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7523 expref: 38 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.537641:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfbe00) 00010000:00010000:3.0:1788940745.537649:0:9713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940745.537678:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddf7f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.537704:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddf7f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.537717:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddf7f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.537743:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.537750:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.537757:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.537864:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf8d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.537873:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.537887:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788940745.539283:0:9713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1788940745.539300:0:9713:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 500872041813ns, next at 501872037826ns, rc = 0 00010000:00010000:3.0:1788940745.539375:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.539392:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.539403:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.539411:0:9713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf94 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.539535:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf94 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.539542:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf94 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.539576:0:9713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940745.539607:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.539613:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf8d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.539619:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.539643:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940745.539649:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.539658:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf8d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.539672:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfbe00) 00010000:00010000:3.0:1788940745.539676:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788940745.539682:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf8d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.539688:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddf8d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.539723:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddf7f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.539730:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddf7f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.541563:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddf7f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.541574:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940745.541579:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddf7f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.541589:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddf7f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.541635:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:3.0:1788940745.541638:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940745.541645:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddf7f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.541652:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddf7f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940745.541677:0:9713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b597f474 reply state 0000000074859f00 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.541692:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.541713:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91cf07e65e00) 00010000:00010000:3.0:1788940745.541716:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788940745.541721:0:9713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788940745.541861:0:10401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940745.541871:0:10401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf94 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940745.541877:0:10401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940745.541887:0:10401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf94 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940745.541894:0:10401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf94 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940745.541904:0:10401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfbe00) 00010000:00010000:2.0:1788940745.541906:0:10401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788940745.541910:0:10401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf94 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940745.541916:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08baddf94 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940745.541931:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940745.541933:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940745.541935:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940745.543328:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+39:12466:x1875839921782528:12345-192.168.202.25@tcp:36:rm.0 Request processed in 5874us (6456us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788940745.543343:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 214 00000100:00100000:0.0:1788940745.633876:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940745.634212:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921782784 00000100:00100000:3.0:1788940745.634227:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921782784 00000100:00100000:3.0:1788940745.634352:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 215 00000100:00100000:3.0:1788940745.634367:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+39:12472:x1875839921782784:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1788940745.634404:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940745.634596:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddf9b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7546 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.634746:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddfa2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.634786:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddfa2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.634803:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddfa2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.634818:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddfa9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.634825:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddfa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.634833:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddfa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788940745.635545:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788940745.635761:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddfb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.635775:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddfb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.635784:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddfb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.635836:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddfa2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.635844:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddfa2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.635852:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddfa2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.635872:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940745.635878:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddfa2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.635887:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddfa2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.635903:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:3.0:1788940745.635907:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940745.635914:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddfa2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.635921:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddfa2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940745.635938:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f128dd9 reply state 00000000c14af02e transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddfa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.635950:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddfa9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.635956:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91cf07e65e00) 00010000:00010000:3.0:1788940745.635958:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788940745.635962:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788940745.636062:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddf9b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7546 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.636079:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddfb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7546 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.636099:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65a00) 00010000:00010000:3.0:1788940745.636101:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940745.636104:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937c00, rc 0) 00000100:00100000:3.0:1788940745.636351:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+42:12472:x1875839921782784:12345-192.168.202.25@tcp:101:bash.0 Request processed in 1986us (2632us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788940745.636361:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 215 00000100:00100000:2.0:1788940745.639878:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940745.640128:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921782912 00000100:00100000:1.0:1788940745.640144:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921782912 00000100:00100000:1.0:1788940745.640330:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:1.0:1788940745.640341:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921782912:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:1.0:1788940745.640365:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940745.640392:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08baddfbe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc754d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940745.640573:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788940745.640603:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788940745.640609:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940745.640621:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08baddfbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc754d expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.640644:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08baddfbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc754d expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.640662:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603800, rc 0) 00000100:00100000:1.0:1788940745.640793:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037887b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+8:2405:x1875839921782912:12345-192.168.202.25@tcp:101:bash.0 Request processed in 454us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940745.640801:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00080000:0.0:1788940745.640929:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940745.646382:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940745.647059:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921783040 00000100:00100000:1.0:1788940745.647189:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921783040 00000100:00100000:1.0:1788940745.647378:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 68 00000100:00100000:1.0:1788940745.647392:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+8:12472:x1875839921783040:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:1.0:1788940745.647574:0:8524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940745.647620:0:8524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fd507b0/0x9c34acc08baddfc5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7554 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.647670:0:8524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08baddfbe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc754d expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.647681:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940745.647687:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940745.647705:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fd507b0/0x9c34acc08baddfc5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7554 expref: 9 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.647763:0:8524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08baddfbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc754d expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.647781:0:8524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08baddfbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc754d expref: 9 pid: 8437 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940745.647800:0:8524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8524:1875839944920704:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940745.647985:0:8524:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940745.656984:0:8524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8524:1875839944920704:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940745.657034:0:8524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008fd507b0/0x9c34acc08baddfc5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7554 expref: 9 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.657062:0:8524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602e00, rc 0) 00000100:00100000:1.0:1788940745.657161:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+9:12472:x1875839921783040:12345-192.168.202.25@tcp:101:bash.0 Request processed in 9771us (10791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940745.657190:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 68 00000100:00100000:2.0:1788940745.657411:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940745.657601:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921783168 00000100:00100000:1.0:1788940745.657612:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921783168 00010000:00010000:1.0:1788940745.657651:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08baddfbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc754d expref: 9 pid: 8437 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940745.657692:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 96 00000100:00100000:1.0:1788940745.657714:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+9:2405:x1875839921783168:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940745.657732:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940745.657760:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08baddfbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc754d expref: 9 pid: 8437 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.657776:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08baddfbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc754d expref: 9 pid: 8437 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.657805:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08baddfbe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc754d expref: 9 pid: 8437 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.658136:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940745.658142:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940745.658154:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008fd507b0/0x9c34acc08baddfc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7554 expref: 8 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.658168:0:7474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fd507b0/0x9c34acc08baddfc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7554 expref: 8 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940745.658764:0:7474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008fd507b0/0x9c34acc08baddfc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7554 expref: 8 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940745.658785:0:7474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7474:1875839944920832:192.168.202.25@tcp:105: 00000100:00100000:1.0:1788940745.659182:0:7474:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940745.663883:0:7474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7474:1875839944920832:192.168.202.25@tcp:105: 00010000:00010000:1.0:1788940745.663922:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940745.663994:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+8:2405:x1875839921783168:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 6282us (7197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940745.664006:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 96 00000100:00100000:3.0:1788940745.667223:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940745.667792:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921783424 00000100:00100000:0.0:1788940745.667808:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921783424 00000100:00100000:0.0:1788940745.667900:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:0.0:1788940745.667913:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+42:12472:x1875839921783424:12345-192.168.202.25@tcp:35:bash.0 00000100:00100000:0.0:1788940745.668393:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+43:12472:x1875839921783424:12345-192.168.202.25@tcp:35:bash.0 Request processed in 481us (1185us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1788940745.668402:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:2.0:1788940745.966570:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940745.966867:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921783552 00000100:00100000:3.0:1788940745.966883:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921783552 00000100:00100000:3.0:1788940745.966999:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 216 00000100:00100000:3.0:1788940745.967017:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+43:12488:x1875839921783552:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940745.967075:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940745.967117:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddfcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc755b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.967593:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddfd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.967619:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddfd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.967647:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddfd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940745.967738:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788940745.967744:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940745.967777:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddfd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.967839:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddfcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc755b expref: 45 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.967866:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddfd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc755b expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.967875:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:3.0:1788940745.967878:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940745.967884:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936600, rc 0) 00000100:00100000:3.0:1788940745.970613:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+44:12488:x1875839921783552:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 3579us (4044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940745.970629:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 216 00000100:00100000:2.0:1788940745.978850:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940745.982578:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921783808 00000100:00100000:3.0:1788940745.982600:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921783808 00000100:00100000:3.0:1788940745.982786:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 217 00000100:00100000:3.0:1788940745.982800:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+44:12488:x1875839921783808:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940745.982830:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940745.982860:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddfda lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7562 expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.983010:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddfe1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.983029:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddfe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.983056:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddfe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940745.983090:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788940745.983287:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08baddfda lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7562 expref: 47 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.983311:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddfe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7562 expref: 46 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940745.983320:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65a00) 00010000:00010000:3.0:1788940745.983323:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940745.983328:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937a00, rc 0) 00000100:00100000:3.0:1788940745.983443:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+46:12488:x1875839921783808:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 646us (4611us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1788940745.983452:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 217 00000100:00100000:2.0:1788940746.006003:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940746.006670:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921783936 00000100:00100000:3.0:1788940746.006704:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921783936 00000100:00100000:3.0:1788940746.006839:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:3.0:1788940746.006855:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+46:2407:x1875839921783936:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940746.006877:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940746.006912:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08baddfe1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7562 expref: 46 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.006941:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65a00) 00010000:00010000:3.0:1788940746.006947:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940746.007060:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+45:2407:x1875839921783936:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 208us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940746.007070:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:2.0:1788940746.008871:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940746.008973:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921784192 00000100:00100000:3.0:1788940746.008986:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921784192 00000100:00100000:3.0:1788940746.009312:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 218 00000100:00100000:3.0:1788940746.009325:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+45:12488:x1875839921784192:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940746.009360:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940746.009549:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218400/0x9c34acc08baddfef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7569 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.009787:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218a00/0x9c34acc08baddff6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.009808:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218a00/0x9c34acc08baddff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.009825:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218a00/0x9c34acc08baddff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940746.009842:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00000100:00080000:0.0:1788940746.010537:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788940746.010828:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218400/0x9c34acc08baddfef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7569 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.010855:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218a00/0x9c34acc08baddff6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7569 expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.010865:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65a00) 00010000:00010000:3.0:1788940746.010868:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788940746.010873:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001218a00, rc 0) 00000100:00100000:3.0:1788940746.019601:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+47:12488:x1875839921784192:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 10252us (10719us total) trans 4294967488 rc 0/0 00000100:00100000:3.0:1788940746.019652:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 218 00000100:00100000:0.0:1788940746.035977:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940746.036969:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921784320 00000100:00100000:1.0:1788940746.036989:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921784320 00000100:00100000:1.0:1788940746.037096:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 69 00000100:00100000:1.0:1788940746.037108:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035df2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+8:2405:x1875839921784320:12345-192.168.202.25@tcp:1:lfs.0 00010000:00010000:1.0:1788940746.037183:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08bade004 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.037208:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008fd507b0/0x9c34acc08baddfc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7554 expref: 8 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.037217:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788940746.037222:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788940746.037228:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08bade004 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.037350:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008fd507b0/0x9c34acc08baddfc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7554 expref: 8 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.037368:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008fd507b0/0x9c34acc08baddfc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7554 expref: 8 pid: 8524 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940746.037388:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8439:1875839944920960:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940746.037540:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940746.042355:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8439:1875839944920960:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940746.042400:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08bade004 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940746.044934:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940746.045111:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921784448 00000100:00100000:2.0:1788940746.045125:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921784448 00002000:00100000:2.0:1788940746.045197:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff91cf08dcd880 x1875839921784448/t0(0) o4->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:722/0 lens 504/0 e 0 to 0 dl 1788940757 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788940746.045210:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91cf08dcd880 with x1875839921784448 ext(0->8) 00010000:00010000:2.0:1788940746.045224:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008fd507b0/0x9c34acc08baddfc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7554 expref: 9 pid: 8524 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.045293:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008fd507b0/0x9c34acc08baddfc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7554 expref: 9 pid: 8524 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788940746.045303:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91cf08dcd880 00000100:00100000:2.0:1788940746.045342:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:2.0:1788940746.045353:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82f3b232-46da-4a78-8599-45df2ddbced0+9:2405:x1875839921784448:12345-192.168.202.25@tcp:4:lfs.0 00000100:00100000:2.0:1788940746.048938:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82f3b232-46da-4a78-8599-45df2ddbced0+11:2405:x1875839921784448:12345-192.168.202.25@tcp:4:lfs.0 Request processed in 3570us (4003us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788940746.048955:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 3 00002000:00100000:2.0:1788940746.048973:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff91cf08dcd880 x1875839921784448/t4294967309(0) o4->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:722/0 lens 504/448 e 0 to 0 dl 1788940757 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788940746.048986:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91cf08dcd880 with x1875839921784448 ext(0->8) 00010000:00010000:2.0:1788940746.049000:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008fd507b0/0x9c34acc08baddfc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7554 expref: 11 pid: 8524 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.049024:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008fd507b0/0x9c34acc08baddfc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7554 expref: 11 pid: 8524 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788940746.049033:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91cf08dcd880 00000001:00080000:1.0:1788940746.052089:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1788940746.052113:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:0.0:1788940746.053531:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940746.055118:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940746.057546:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921784576 00000100:00100000:2.0:1788940746.057572:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921784576 00010000:00010000:0.0:1788940746.057941:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008fd507b0/0x9c34acc08baddfc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7554 expref: 7 pid: 8524 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940746.058549:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 97 00000100:00100000:0.0:1788940746.058566:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+7:2404:x1875839921784576:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940746.058589:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788940746.058632:0:6507:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788940746.058636:0:6507:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788940746 00002000:00010000:0.0:1788940746.058639:0:6507:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788940746 00002000:00010000:0.0:1788940746.058641:0:6507:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788940746 00002000:00010000:0.0:1788940746.058644:0:6507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788940746.058653:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008fd507b0/0x9c34acc08baddfc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7554 expref: 7 pid: 8524 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.058671:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008fd507b0/0x9c34acc08baddfc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7554 expref: 7 pid: 8524 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.058710:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fd507b0/0x9c34acc08baddfc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7554 expref: 7 pid: 8524 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.058729:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940746.058735:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940746.058742:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08bade004 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.058754:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08bade004 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.058801:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940746.058896:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+6:2404:x1875839921784576:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 336us (3859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940746.058905:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 97 00010000:00010000:2.0:1788940746.058990:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08bade004 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.059014:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08bade004 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.059053:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08bade004 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.059063:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08bade004 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.059072:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08bade004 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.059080:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940746.059085:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08bade004 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.059096:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08bade004 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.059110:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08bade004 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.059119:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08bade004 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940746.059191:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035df2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921784320:12345-192.168.202.25@tcp:1:lfs.0 Request processed in 22085us (23232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940746.059201:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 69 00000100:00100000:2.0:1788940746.063351:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940746.063457:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921784832 00000100:00100000:3.0:1788940746.063472:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921784832 00000100:00100000:3.0:1788940746.063553:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:3.0:1788940746.063565:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d002e66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+47:12488:x1875839921784832:12345-192.168.202.25@tcp:35:lfs.0 00000004:00010000:3.0:1788940746.063658:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218a00/0x9c34acc08baddff6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7569 expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940746.064486:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788940746.064536:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1788940746.065780:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:3.0:1788940746.066521:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218400/0x9c34acc08bade00b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.066549:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddfb0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7546 expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.066559:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218400/0x9c34acc08bade00b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.066609:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddfb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7546 expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.066629:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddfb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7546 expref: 51 pid: 6521 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940746.066649:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1875839944921088:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788940746.066957:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940746.073656:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940746.073852:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921784960 00000100:00100000:2.0:1788940746.073867:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921784960 00010000:00010000:2.0:1788940746.073924:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddfb0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7546 expref: 52 pid: 6521 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940746.073983:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 98 00000100:00100000:2.0:1788940746.073995:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+52:2405:x1875839921784960:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940746.074016:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940746.074024:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddfb0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7546 expref: 52 pid: 6521 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.074049:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddfb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7546 expref: 52 pid: 6521 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.074080:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65a00) 00010000:00010000:2.0:1788940746.074087:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218400/0x9c34acc08bade00b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.074098:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218400/0x9c34acc08bade00b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.074106:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218400/0x9c34acc08bade00b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.074150:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940746.074225:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+52:2405:x1875839921784960:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 231us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940746.074233:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 98 00010000:00010000:1.0:1788940746.076129:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08baddfb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7546 expref: 51 pid: 6521 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940746.076164:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1875839944921088:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940746.076201:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218400/0x9c34acc08bade00b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.076213:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218400/0x9c34acc08bade00b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.076219:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218400/0x9c34acc08bade00b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788940746.076593:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:1.0:1788940746.076752:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1788940746.076963:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875839944921216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788940746.077144:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940746.077518:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944921216 00000100:00100000:2.0:1788940746.077530:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944921216 00000100:00100000:1.0:1788940746.077636:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940746.077746:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788940746.077759:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1875839944921216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788940746.077894:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1875839944921216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 138us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940746.077903:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788940746.077988:0:6523:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:1.0:1788940746.077995:0:6523:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:1.0:1788940746.078021:0:6523:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d00137aa00, transno 4294967308 00000100:00100000:1.0:1788940746.078052:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875839944921216:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788940746.078229:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:1.0:1788940746.078364:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875839944921344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788940746.078409:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940746.078441:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940746.079068:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944921344 00000100:00100000:2.0:1788940746.079079:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944921344 00000100:00100000:2.0:1788940746.079140:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788940746.079149:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1875839944921344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788940746.079375:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1875839944921344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 226us (964us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788940746.079385:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788940746.079784:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875839944921344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788940746.079884:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1788940746.079942:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218400/0x9c34acc08bade00b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.079957:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218400/0x9c34acc08bade00b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.079968:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218400/0x9c34acc08bade00b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.079977:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940746.079983:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218400/0x9c34acc08bade00b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.080023:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218400/0x9c34acc08bade00b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.080169:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65a00) 00010000:00010000:1.0:1788940746.080174:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788940746.080183:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218400/0x9c34acc08bade00b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.080191:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218400/0x9c34acc08bade00b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788940746.080504:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788940746.080585:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788940746.080603:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 501413344555ns, next at 502413340483ns, rc = 0 00000001:00080000:1.0:1788940746.080611:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:1.0:1788940746.080642:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65a00) 00010000:00010000:1.0:1788940746.080646:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788940746.080655:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218a00/0x9c34acc08baddff6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7569 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940746.081022:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d002e66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+54:12488:x1875839921784832:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 17457us (17685us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788940746.081035:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 56 00000020:00080000:1.0:1788940746.081053:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1788940746.081302:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940746.085360:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940746.085565:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921785088 00000100:00100000:3.0:1788940746.085579:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921785088 00000100:00100000:3.0:1788940746.085662:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 219 00000100:00100000:3.0:1788940746.085675:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+54:12488:x1875839921785088:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940746.085719:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940746.085753:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08bade012 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7570 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.085970:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08bade012 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7570 expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.085992:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08bade012 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7570 expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.086017:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:3.0:1788940746.086020:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940746.086025:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219a00, rc 0) 00000100:00100000:3.0:1788940746.086123:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+55:12488:x1875839921785088:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 450us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940746.086131:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 219 00000100:00100000:0.0:1788940746.089687:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940746.090773:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921785344 00000100:00100000:2.0:1788940746.090793:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921785344 00000100:00100000:3.0:1788940746.091171:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:3.0:1788940746.091185:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+55:12488:x1875839921785344:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:3.0:1788940746.095785:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+56:12488:x1875839921785344:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 4580us (6093us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788940746.096535:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:0.0:1788940746.286773:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940746.286917:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921785472 00000100:00100000:3.0:1788940746.286933:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921785472 00000100:00100000:3.0:1788940746.287030:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 220 00000100:00100000:3.0:1788940746.287053:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+56:12498:x1875839921785472:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:3.0:1788940746.287182:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade019 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287208:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade019 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287226:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade019 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287240:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade020 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287497:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade020 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287508:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade020 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287625:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219000/0x9c34acc08bade027 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287635:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219000/0x9c34acc08bade027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287642:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219000/0x9c34acc08bade027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940746.287762:0:9713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219000/0x9c34acc08bade027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287784:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade019 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287793:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade019 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287802:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade019 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287809:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940746.287815:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade019 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287824:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade019 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287841:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:3.0:1788940746.287844:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940746.287852:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade019 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287859:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade019 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287878:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade020 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287885:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade020 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287899:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade020 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287905:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940746.287908:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade020 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287916:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade020 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287925:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91cf07e65e00) 00010000:00010000:3.0:1788940746.287928:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940746.287931:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade020 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287936:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade020 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287947:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219000/0x9c34acc08bade027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287953:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219000/0x9c34acc08bade027 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287957:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219000/0x9c34acc08bade027 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287962:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940746.287965:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219000/0x9c34acc08bade027 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287985:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219000/0x9c34acc08bade027 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.287992:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:3.0:1788940746.287995:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940746.287998:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219000/0x9c34acc08bade027 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.288003:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219000/0x9c34acc08bade027 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940746.289704:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+56:12498:x1875839921785472:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 2629us (2924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940746.289722:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 220 00000100:00100000:1.0:1788940746.362745:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940746.368091:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921785728 00000100:00100000:3.0:1788940746.368116:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921785728 00000100:00100000:3.0:1788940746.368237:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 221 00000100:00100000:3.0:1788940746.368564:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+56:12501:x1875839921785728:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940746.368600:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940746.368628:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219000/0x9c34acc08bade02e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7577 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.368744:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade035 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.368765:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade035 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.368783:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade035 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.368819:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade03c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.368828:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade03c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.368835:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade03c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.369000:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219600/0x9c34acc08bade043 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.369009:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219600/0x9c34acc08bade043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.369017:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219600/0x9c34acc08bade043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940746.369028:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788940746.373006:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade035 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.373033:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade035 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.373055:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade035 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.373085:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940746.373091:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade035 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.373101:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade035 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.373122:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:2.0:1788940746.373125:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940746.373131:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade035 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.373139:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade035 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.373157:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade03c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.373163:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade03c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.373168:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade03c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.373173:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940746.373177:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade03c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.373183:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade03c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.373202:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91cf07e65e00) 00010000:00010000:2.0:1788940746.373205:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940746.373209:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade03c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.373215:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08bade03c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.373355:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219000/0x9c34acc08bade02e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7577 expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.373374:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219600/0x9c34acc08bade043 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7577 expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.373382:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:2.0:1788940746.373385:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940746.373387:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219600, rc 0) 00000100:00100000:2.0:1788940746.373869:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+58:12501:x1875839921785728:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 5616us (11137us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1788940746.373882:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 221 00000100:00100000:3.0:1788940746.383137:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940746.384962:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921785856 00000100:00100000:0.0:1788940746.384985:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921785856 00000100:00100000:0.0:1788940746.385245:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 222 00000100:00100000:0.0:1788940746.385293:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+58:12501:x1875839921785856:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:0.0:1788940746.385398:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade051 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.385436:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade051 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.385453:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade051 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.385507:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade051 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.385516:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade051 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.385523:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade051 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.385530:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940746.385535:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade051 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.385544:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade051 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.385580:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:0.0:1788940746.385583:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940746.385589:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade051 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.385597:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade051 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940746.385819:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+58:12501:x1875839921785856:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 529us (2696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940746.385828:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 222 00000100:00100000:1.0:1788940746.401408:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940746.401643:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921786112 00000100:00100000:2.0:1788940746.401670:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921786112 00000100:00100000:2.0:1788940746.401754:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:2.0:1788940746.401767:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+58:12501:x1875839921786112:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:2.0:1788940746.402646:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+59:12501:x1875839921786112:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 877us (1249us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788940746.402668:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:2.0:1788940746.546008:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940746.546496:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921786368 00000100:00100000:3.0:1788940746.546511:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921786368 00000100:00100000:3.0:1788940746.546592:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 223 00000100:00100000:3.0:1788940746.546604:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+59:12511:x1875839921786368:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1788940746.546637:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940746.546641:0:9713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788940746.546694:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08baddfd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc755b expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.546743:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:3.0:1788940746.546750:0:9713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940746.546768:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218c00/0x9c34acc08bade058 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc757e expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.546914:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219200/0x9c34acc08bade05f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.546931:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219200/0x9c34acc08bade05f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.546944:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219200/0x9c34acc08bade05f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940746.546957:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788940746.547240:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218c00/0x9c34acc08bade058 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc757e expref: 61 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.548150:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219200/0x9c34acc08bade05f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc757e expref: 60 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.548160:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:3.0:1788940746.548163:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940746.548166:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219200, rc 0) 00000100:00100000:3.0:1788940746.548312:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+60:12511:x1875839921786368:12345-192.168.202.25@tcp:101:bash.0 Request processed in 1707us (2318us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788940746.548322:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 223 00000100:00100000:0.0:1788940746.558463:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940746.559145:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921786496 00000100:00100000:1.0:1788940746.559165:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921786496 00000100:00100000:1.0:1788940746.559305:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:1.0:1788940746.559320:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+60:2404:x1875839921786496:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940746.559348:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940746.559389:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219200/0x9c34acc08bade05f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc757e expref: 60 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.560696:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:1.0:1788940746.560713:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940746.563519:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+59:2404:x1875839921786496:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 4179us (5043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940746.563540:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:0.0:1788940746.564087:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940746.564192:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921786624 00000100:00100000:2.0:1788940746.564202:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921786624 00000100:00100000:2.0:1788940746.564299:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 224 00000100:00100000:2.0:1788940746.564311:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+59:12511:x1875839921786624:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1788940746.564353:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940746.564388:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08bade06d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7585 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.564427:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08bade074 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.564444:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08bade074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.564459:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08bade074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.564938:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08bade06d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7585 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.564955:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08bade074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7585 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940746.564964:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:2.0:1788940746.564967:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788940746.564971:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6c00, rc 0) 00000100:00100000:2.0:1788940746.565069:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+60:12511:x1875839921786624:12345-192.168.202.25@tcp:101:bash.0 Request processed in 760us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940746.565093:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 224 00000100:00100000:2.0:1788940746.585902:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940746.586201:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921786880 00000100:00100000:0.0:1788940746.586212:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921786880 00000100:00100000:0.0:1788940746.586345:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 225 00000100:00100000:0.0:1788940746.586357:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+60:12511:x1875839921786880:12345-192.168.202.25@tcp:36:bash.0 00010000:00010000:0.0:1788940746.586422:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940746.586466:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219600/0x9c34acc08bade043 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7577 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.586501:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:0.0:1788940746.586507:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940746.587476:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade07b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.587493:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade07b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.587522:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade07b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940746.587745:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:0.0:1788940746.587772:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ab39a25 reply state 00000000038b5521 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade07b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.587785:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade07b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.587791:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:0.0:1788940746.587793:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788940746.587796:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940746.588236:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+62:12511:x1875839921786880:12345-192.168.202.25@tcp:36:bash.0 Request processed in 1878us (2340us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1788940746.588283:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 225 00000020:00080000:0.0:1788940746.588289:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788940746.603448:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940746.603776:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921787008 00000100:00100000:3.0:1788940746.603790:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921787008 00000100:00100000:3.0:1788940746.603855:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 226 00000100:00100000:3.0:1788940746.603866:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+62:12511:x1875839921787008:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1788940746.603892:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940746.603913:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218c00/0x9c34acc08bade082 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc758c expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.604011:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219c00/0x9c34acc08bade089 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.604029:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219c00/0x9c34acc08bade089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.604043:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219c00/0x9c34acc08bade089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940746.604086:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788940746.604091:0:9713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940746.604114:0:9713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219c00/0x9c34acc08bade089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.604142:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218c00/0x9c34acc08bade082 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc758c expref: 64 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.604160:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219c00/0x9c34acc08bade089 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc758c expref: 63 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.604168:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:3.0:1788940746.604171:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940746.604188:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219c00, rc 0) 00000100:00100000:3.0:1788940746.604289:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+63:12511:x1875839921787008:12345-192.168.202.25@tcp:101:bash.0 Request processed in 424us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940746.604296:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 226 00000100:00100000:0.0:1788940746.611337:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940746.611549:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921787264 00000100:00100000:2.0:1788940746.611559:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921787264 00000100:00100000:2.0:1788940746.611615:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:2.0:1788940746.611637:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+63:12511:x1875839921787264:12345-192.168.202.25@tcp:35:bash.0 00000100:00100000:2.0:1788940746.611965:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+64:12511:x1875839921787264:12345-192.168.202.25@tcp:35:bash.0 Request processed in 323us (632us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788940746.611973:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:2.0:1788940746.802841:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940746.802961:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921787392 00000100:00100000:0.0:1788940746.802979:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921787392 00000100:00100000:0.0:1788940746.803064:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 227 00000100:00100000:0.0:1788940746.803075:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+64:12517:x1875839921787392:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1788940746.803099:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940746.803119:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08bade090 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7593 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.803190:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08bade097 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.803221:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08bade097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.803235:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08bade097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940746.803318:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788940746.803323:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788940746.803342:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08bade097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.803365:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08bade090 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7593 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.803386:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08bade097 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7593 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.803396:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:0.0:1788940746.803399:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940746.803403:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d000031200, rc 0) 00000100:00100000:0.0:1788940746.803478:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+65:12517:x1875839921787392:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 404us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940746.803486:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 227 00000100:00100000:0.0:1788940746.808141:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940746.808320:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921787520 00000100:00100000:3.0:1788940746.808337:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921787520 00000100:00100000:3.0:1788940746.808429:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 228 00000100:00100000:3.0:1788940746.808444:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+65:12517:x1875839921787520:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940746.808481:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940746.808526:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218c00/0x9c34acc08bade09e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc759a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.808621:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade0a5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.808640:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade0a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.808655:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade0a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.808678:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade0ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.808695:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade0ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.808702:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade0ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.808822:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade0b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.808852:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.808860:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940746.808921:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788940746.808927:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940746.808956:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.808969:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.808979:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade0a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.808986:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade0a5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.808993:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade0a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.809000:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940746.809005:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade0a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.809013:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade0a5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.809026:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:3.0:1788940746.809029:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940746.809042:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade0a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.809048:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade0a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.809066:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade0ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.809073:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade0ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.809078:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade0ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.809084:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940746.809087:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade0ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.809092:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade0ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.809101:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91cf07e65e00) 00010000:00010000:3.0:1788940746.809103:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940746.809107:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade0ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.809113:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade0ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.809146:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218c00/0x9c34acc08bade09e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc759a expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.809179:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade0b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc759a expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.809187:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:3.0:1788940746.809189:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940746.809192:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001218800, rc 0) 00000100:00100000:3.0:1788940746.809316:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+66:12517:x1875839921787520:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 875us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940746.809325:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 228 00000100:00100000:2.0:1788940746.815052:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940746.815617:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921787904 00000100:00100000:3.0:1788940746.815634:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921787904 00000100:00100000:3.0:1788940746.817144:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:3.0:1788940746.817168:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+66:2405:x1875839921787904:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940746.817192:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940746.817227:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade0b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc759a expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.817303:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:3.0:1788940746.817310:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940746.817389:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+65:2405:x1875839921787904:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 231us (2356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940746.817398:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:2.0:1788940746.834216:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940746.834637:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921787776 00000100:00100000:1.0:1788940746.834653:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921787776 00000100:00100000:1.0:1788940746.834948:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 229 00000100:00100000:1.0:1788940746.834962:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+65:12517:x1875839921787776:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788940746.835286:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940746.835314:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08bade0ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc75a1 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.835849:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08bade0c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.835871:0:8517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219c00/0x9c34acc08bade089 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc758c expref: 66 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.835882:0:8517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08bade0c1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.835961:0:8517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219c00/0x9c34acc08bade089 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc758c expref: 66 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.835978:0:8517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219c00/0x9c34acc08bade089 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc758c expref: 66 pid: 9713 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940746.835996:0:8517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944921472:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940746.836205:0:8517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c303c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940746.854350:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940746.855279:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921788032 00000100:00100000:3.0:1788940746.855295:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921788032 00010000:00010000:3.0:1788940746.855353:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219c00/0x9c34acc08bade089 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc758c expref: 67 pid: 9713 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940746.855448:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 99 00000100:00100000:3.0:1788940746.855462:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+67:2404:x1875839921788032:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940746.855482:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940746.855492:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219c00/0x9c34acc08bade089 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc758c expref: 67 pid: 9713 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.855508:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219c00/0x9c34acc08bade089 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc758c expref: 67 pid: 9713 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.855537:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:3.0:1788940746.855543:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08bade0c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.855556:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08bade0c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.855566:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08bade0c1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940746.855591:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940746.855670:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+67:2404:x1875839921788032:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 211us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940746.855678:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 99 00010000:00010000:1.0:1788940746.856203:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219c00/0x9c34acc08bade089 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc758c expref: 66 pid: 9713 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940746.856226:0:8517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944921472:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940746.856251:0:8517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08bade0c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.856311:0:8517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08bade0c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.856317:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08bade0c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940746.856341:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788940746.856522:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08bade0ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75a1 expref: 67 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.856541:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08bade0c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75a1 expref: 66 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.856563:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:1.0:1788940746.856566:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788940746.856569:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602200, rc 0) 00000100:00100000:1.0:1788940746.856630:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+66:12517:x1875839921787776:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 21672us (22433us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788940746.856638:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 229 00000100:00100000:0.0:1788940746.864985:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940746.865072:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921788288 00000100:00100000:1.0:1788940746.865086:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921788288 00000100:00100000:1.0:1788940746.865174:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:1.0:1788940746.865187:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+66:12517:x1875839921788288:12345-192.168.202.25@tcp:103:lfs.0 00010000:00010000:1.0:1788940746.865208:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940746.865290:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08bade012 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7570 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940746.865314:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:1.0:1788940746.865321:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940746.865398:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+65:12517:x1875839921788288:12345-192.168.202.25@tcp:103:lfs.0 Request processed in 212us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940746.865406:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:3.0:1788940746.868368:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940746.868484:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921788416 00000100:00100000:0.0:1788940746.868496:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921788416 00000100:00100000:0.0:1788940746.868589:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 230 00000100:00100000:0.0:1788940746.868601:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+65:12517:x1875839921788416:12345-192.168.202.25@tcp:58:lfs.0 00010000:00010000:0.0:1788940746.868913:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08bade0cf lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.868938:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08bade0cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.868955:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08bade0cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788940746.869098:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788940746.869213:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+65:12517:x1875839921788416:12345-192.168.202.25@tcp:58:lfs.0 Request processed in 613us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940746.869223:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 230 00000100:00100000:2.0:1788940746.880649:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940746.880772:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921788544 00000100:00100000:0.0:1788940746.880788:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921788544 00000100:00100000:0.0:1788940746.880872:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 231 00000100:00100000:0.0:1788940746.880885:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+65:12517:x1875839921788544:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1788940746.880919:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940746.880952:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08bade0d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc75a8 expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.881028:0:9713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08bade0cf lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.881040:0:9713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08bade0d6 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75a8 expref: 66 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.881086:0:9713:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08bade0cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.881104:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08bade0d6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75a8 expref: 66 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.881122:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:0.0:1788940746.881125:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788940746.881129:0:9713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08bade0d6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75a8 expref: 66 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940746.881137:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d000031e00, rc 0) 00000100:00100000:0.0:1788940746.881229:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+66:12517:x1875839921788544:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 345us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940746.881236:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 231 00000100:00100000:3.0:1788940746.907776:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940746.907809:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944921600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940746.907911:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940746.908117:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944921600 00000100:00100000:2.0:1788940746.908129:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944921600 00000100:00100000:2.0:1788940746.908196:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788940746.908207:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944921600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940746.908302:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788940746.908364:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944921600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 158us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940746.908372:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788940746.908534:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944921600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788940747.047778:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940747.047839:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940747.047871:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940747.047914:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940747.047974:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921788672 00000100:00100000:1.0:1788940747.047988:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921788672 00000100:00100000:1.0:1788940747.048071:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 405 00000100:00100000:1.0:1788940747.048083:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2405:x1875839921788672:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940747.048179:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2405:x1875839921788672:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 98us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940747.048187:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 405 00000100:00100000:1.0:1788940747.048315:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940747.048343:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921789056 00000100:00100000:1.0:1788940747.048349:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921789056 00000100:00100000:1.0:1788940747.048394:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921788928 00000100:00100000:1.0:1788940747.048398:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921788928 00000100:00100000:1.0:1788940747.048433:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 150 00000100:00100000:1.0:1788940747.048440:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921789056:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940747.048475:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921789056:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 35us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940747.048482:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 150 00000100:00100000:1.0:1788940747.048496:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 151 00000100:00100000:1.0:1788940747.048502:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+9:2405:x1875839921788928:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940747.048528:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+9:2405:x1875839921788928:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940747.048534:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 151 00000100:00080000:1.0:1788940747.048556:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940747.048560:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940747.048640:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940747.048842:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921788800 00000100:00100000:0.0:1788940747.048848:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921788800 00000100:00100000:0.0:1788940747.048902:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921789312 00000100:00100000:0.0:1788940747.048906:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921789312 00000100:00100000:0.0:1788940747.048933:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921789184 00000100:00100000:0.0:1788940747.048936:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921789184 00000100:00100000:0.0:1788940747.048958:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 393 00000100:00100000:0.0:1788940747.048966:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921788800:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940747.049008:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921788800:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 43us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940747.049015:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 393 00000100:00100000:0.0:1788940747.049045:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 394 00000100:00100000:0.0:1788940747.049051:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921789312:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940747.049079:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921789312:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940747.049085:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 394 00000100:00100000:0.0:1788940747.049097:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 395 00000100:00100000:0.0:1788940747.049103:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921789184:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940747.049127:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921789184:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 24us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940747.049133:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 395 00000100:00080000:1.0:1788940747.052170:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940747.052206:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788940747.106436:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940747.419974:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940747.420006:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944921728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940747.420127:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940747.420434:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944921728 00000100:00100000:1.0:1788940747.420445:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944921728 00000100:00100000:1.0:1788940747.420527:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788940747.420539:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944921728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788940747.420580:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788940747.420635:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944921728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940747.420642:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000004:00080000:3.0:1788940747.420670:0:8523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 502753411569ns, next at 503753396942ns, rc = 0 00000100:00100000:2.0:1788940747.420965:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940747.420978:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944921856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940747.421014:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788940747.421771:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940747.421839:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944921728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940747.425922:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944921856 00000100:00100000:1.0:1788940747.425944:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944921856 00000100:00100000:1.0:1788940747.426489:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788940747.426504:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875839944921856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940747.426544:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788940747.426692:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875839944921856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (5664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940747.426702:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788940747.427017:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944921856:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788940747.432383:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788940747.611523:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940747.611535:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940747.611594:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788940747.611607:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788940747.611900:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1875839944921984:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788940747.612055:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940747.617499:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940747.617794:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921789440 00000100:00100000:2.0:1788940747.617806:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921789440 00000100:00100000:2.0:1788940747.617919:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 232 00000100:00100000:2.0:1788940747.617931:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+67:12518:x1875839921789440:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788940747.617974:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788940747.618145:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+67:12518:x1875839921789440:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 216us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940747.618153:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 232 00000100:00100000:0.0:1788940747.618459:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1875839944921984:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788940747.632459:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940747.634703:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921789568 00000100:00100000:0.0:1788940747.634724:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921789568 00000100:00100000:0.0:1788940747.634819:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 233 00000100:00100000:0.0:1788940747.634832:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+66:12518:x1875839921789568:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788940747.634938:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08bade0dd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.634962:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08bade0dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.634997:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08bade0dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635016:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08bade0e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635036:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08bade0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635044:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08bade0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635077:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade0eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635087:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade0eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635094:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade0eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940747.635159:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788940747.635165:0:9713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788940747.635181:0:9713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade0eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635194:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08bade0dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635202:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08bade0dd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635220:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08bade0dd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635226:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000030e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940747.635231:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08bade0dd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635252:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08bade0dd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635305:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91cf07e67400) 00010000:00010000:0.0:1788940747.635308:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940747.635314:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08bade0dd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635321:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000030e00/0x9c34acc08bade0dd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635340:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08bade0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635347:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08bade0e4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635352:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08bade0e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635357:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940747.635360:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08bade0e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635376:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08bade0e4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635384:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff91d0421d1200) 00010000:00010000:0.0:1788940747.635386:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940747.635390:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08bade0e4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635409:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031000/0x9c34acc08bade0e4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635428:0:9713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade0eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635434:0:9713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade0eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635440:0:9713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade0eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635444:0:9713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584de00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940747.635446:0:9713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade0eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635451:0:9713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade0eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635458:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:0.0:1788940747.635461:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940747.635464:0:9713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade0eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.635484:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade0eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940747.635612:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+66:12518:x1875839921789568:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 Request processed in 779us (3168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940747.635621:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 233 00000100:00100000:3.0:1788940747.640333:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940747.640604:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921789824 00000100:00100000:2.0:1788940747.640619:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921789824 00000100:00100000:2.0:1788940747.640715:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 234 00000100:00100000:2.0:1788940747.640728:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+66:12518:x1875839921789824:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940747.640759:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940747.640788:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade0f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc75af expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.640949:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08bade0f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.640970:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08bade0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.640986:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08bade0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940747.641001:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788940747.641617:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08bade0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.641629:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08bade0f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.641647:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08bade0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.641654:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940747.641660:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08bade0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.641670:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08bade0f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.641702:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:2.0:1788940747.641705:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788940747.641713:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08bade0f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.641722:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7c00/0x9c34acc08bade0f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.641780:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade0f2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75af expref: 68 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.641791:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91cf07e67400) 00010000:00010000:2.0:1788940747.641793:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940747.641797:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade0f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75af expref: 68 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.641808:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6a00, rc 0) 00000100:00100000:2.0:1788940747.641898:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+67:12518:x1875839921789824:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1172us (1580us total) trans 4294967506 rc 301/301 00000100:00100000:2.0:1788940747.641917:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 234 00000100:00100000:2.0:1788940747.652975:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940747.653070:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921789952 00000100:00100000:1.0:1788940747.653086:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921789952 00000100:00100000:1.0:1788940747.653168:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 235 00000100:00100000:1.0:1788940747.653180:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+67:12518:x1875839921789952:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788940747.653246:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788940747.653431:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+67:12518:x1875839921789952:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 252us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940747.653441:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 235 00000100:00100000:1.0:1788940747.659814:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940747.674072:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921790208 00000100:00100000:3.0:1788940747.674095:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921790208 00000100:00100000:3.0:1788940747.674227:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 236 00000100:00100000:3.0:1788940747.674250:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+67:12518:x1875839921790208:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940747.674309:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940747.674314:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788940747.674357:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031200/0x9c34acc08bade097 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7593 expref: 67 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.674384:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:3.0:1788940747.674391:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940747.674958:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade107 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc75b6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788940747.678392:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:3.0:1788940747.678868:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218c00/0x9c34acc08bade10e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.678911:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218c00/0x9c34acc08bade10e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.678927:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218c00/0x9c34acc08bade10e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.679020:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade107 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75b6 expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.679385:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218c00/0x9c34acc08bade10e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75b6 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.679467:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91cf07e65b00) 00010000:00010000:3.0:1788940747.679472:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940747.679478:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001218c00, rc 0) 00000100:00100000:3.0:1788940747.679653:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+68:12518:x1875839921790208:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 5413us (20271us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788940747.679664:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 236 00000100:00100000:2.0:1788940747.713056:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940747.713169:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921790464 00000100:00100000:0.0:1788940747.713183:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921790464 00000100:00100000:0.0:1788940747.713296:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 237 00000100:00100000:0.0:1788940747.713309:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+68:12518:x1875839921790464:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788940747.713382:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940747.713428:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218c00/0x9c34acc08bade10e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75b6 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713448:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91cf07e65b00) 00010000:00010000:0.0:1788940747.713460:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940747.713487:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade11c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713502:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade11c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713512:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade11c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713527:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade123 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xa301a734 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713533:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade123 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa301a734 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713560:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade123 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa301a734 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713620:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade11c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713627:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade11c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713635:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade11c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713641:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584de00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940747.713647:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade11c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713656:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade11c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713665:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:0.0:1788940747.713668:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940747.713672:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade11c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713689:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584de00/0x9c34acc08bade11c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713700:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade123 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa301a734 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713706:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade123 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa301a734 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713719:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade123 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa301a734 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713724:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584ca00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940747.713727:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade123 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa301a734 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713733:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade123 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa301a734 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713741:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xa301a734 (ffff91d0421d1200) 00010000:00010000:0.0:1788940747.713744:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940747.713746:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade123 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xa301a734 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.713752:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade123 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xa301a734 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940747.713864:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+67:12518:x1875839921790464:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 556us (820us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940747.713871:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 237 00000100:00100000:2.0:1788940747.718480:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940747.718580:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921790592 00000100:00100000:0.0:1788940747.718596:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921790592 00000100:00100000:0.0:1788940747.718684:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 238 00000100:00100000:0.0:1788940747.718697:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+67:12518:x1875839921790592:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940747.718729:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940747.718764:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08bade12a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc75bd expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.718843:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08bade131 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.718861:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08bade131 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.718876:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08bade131 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.719030:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08bade12a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75bd expref: 69 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.719053:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08bade131 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75bd expref: 68 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.719064:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91d0421d1e00) 00010000:00010000:0.0:1788940747.719067:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788940747.719072:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c200, rc 0) 00000100:00100000:0.0:1788940747.719163:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+68:12518:x1875839921790592:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 467us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940747.719172:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 238 00000100:00100000:3.0:1788940747.723893:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940747.724531:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921790848 00000100:00100000:0.0:1788940747.724547:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921790848 00000100:00100000:0.0:1788940747.724627:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 239 00000100:00100000:0.0:1788940747.724638:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+68:12518:x1875839921790848:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788940747.724907:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade138 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.724954:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.724971:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788940747.725936:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1788940747.726020:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c4e3788 reply state 000000009771b682 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.726039:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade138 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.731020:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91d0421d1e00) 00010000:00010000:0.0:1788940747.731034:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788940747.731187:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940747.731417:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+70:12518:x1875839921790848:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 6773us (7532us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1788940747.731428:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 239 00000100:00100000:3.0:1788940747.742964:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940747.743212:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921790976 00000100:00100000:2.0:1788940747.743226:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921790976 00000100:00100000:2.0:1788940747.743338:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 240 00000100:00100000:2.0:1788940747.743351:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+70:12518:x1875839921790976:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940747.743386:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940747.743425:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade13f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc75c4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.743510:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade13f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75c4 expref: 71 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.743528:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade13f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75c4 expref: 71 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.743563:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91d0421d1e00) 00010000:00010000:2.0:1788940747.743567:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940747.743572:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7600, rc 0) 00000100:00100000:2.0:1788940747.743653:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+71:12518:x1875839921790976:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 304us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940747.743661:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 240 00000100:00100000:2.0:1788940747.748704:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940747.760729:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921791104 00000100:00100000:1.0:1788940747.760755:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921791104 00000100:00100000:1.0:1788940747.760855:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 70 00000100:00100000:1.0:1788940747.760869:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+9:2404:x1875839921791104:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788940747.761364:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+10:2404:x1875839921791104:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 496us (12685us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788940747.761373:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 70 00000100:00100000:3.0:1788940747.772507:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940747.775509:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921791360 00000100:00100000:2.0:1788940747.775577:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921791360 00000100:00100000:2.0:1788940747.775684:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 60 00000100:00100000:2.0:1788940747.775707:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+71:12518:x1875839921791360:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788940747.776788:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+72:12518:x1875839921791360:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 1078us (4288us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788940747.776808:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 60 00000100:00100000:2.0:1788940747.790388:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940747.792891:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921791616 00000100:00100000:1.0:1788940747.792916:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921791616 00000100:00100000:1.0:1788940747.793032:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 241 00000100:00100000:1.0:1788940747.793054:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+72:12518:x1875839921791616:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788940747.793301:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+72:12518:x1875839921791616:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 256us (3915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940747.793311:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 241 00000100:00100000:0.0:1788940747.799991:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940747.802252:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921791744 00000100:00100000:3.0:1788940747.802323:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921791744 00000100:00100000:3.0:1788940747.802451:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 242 00000100:00100000:3.0:1788940747.802467:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+72:12518:x1875839921791744:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940747.802503:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940747.802538:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade146 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc75cb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.802691:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade14d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.802715:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade14d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.802979:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade14d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940747.803049:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940747.803077:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade14d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.803113:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade146 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75cb expref: 74 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.803137:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade14d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75cb expref: 73 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.803146:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91d0421d1e00) 00010000:00010000:3.0:1788940747.803149:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788940747.803154:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001218800, rc 0) 00000100:00100000:3.0:1788940747.803517:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+73:12518:x1875839921791744:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1052us (3540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940747.803526:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 242 00000100:00100000:3.0:1788940747.825112:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940747.825318:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921791872 00000100:00100000:1.0:1788940747.825332:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921791872 00000100:00100000:1.0:1788940747.825409:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 71 00000100:00100000:1.0:1788940747.825422:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+10:2404:x1875839921791872:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940747.825448:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940747.825482:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade154 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc75d2 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940747.825515:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa111cc, blocks: 0x0 00010000:00010000:1.0:1788940747.825551:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=503s v=(0 0) 00010000:00010000:1.0:1788940747.825557:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940747.825569:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade154 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d2 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.825612:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade154 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d2 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.825629:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602000, rc 0) 00000100:00100000:1.0:1788940747.825728:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+11:2404:x1875839921791872:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 309us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940747.825736:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 71 00000100:00100000:3.0:1788940747.829463:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940747.829651:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921792128 00000100:00100000:0.0:1788940747.829691:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921792128 00000100:00100000:0.0:1788940747.829789:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 243 00000100:00100000:0.0:1788940747.829811:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+73:12518:x1875839921792128:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788940747.829970:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+73:12518:x1875839921792128:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 162us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940747.829978:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 243 00000100:00100000:0.0:1788940747.843569:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940747.844148:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921792256 00000100:00100000:1.0:1788940747.844165:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921792256 00000100:00100000:1.0:1788940747.844319:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 72 00000100:00100000:1.0:1788940747.844333:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+11:12518:x1875839921792256:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940747.844363:0:8524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940747.844620:0:8524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08bade15b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc75d9 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.844689:0:8524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade154 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d2 expref: 12 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.844701:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940747.844707:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940747.844715:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08bade15b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d9 expref: 12 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.844771:0:8524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade154 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d2 expref: 12 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.844813:0:8524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade154 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d2 expref: 12 pid: 8438 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940747.844832:0:8524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8524:1875839944922112:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940747.844994:0:8524:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940747.861041:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940747.862035:0:8524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8524:1875839944922112:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940747.862080:0:8524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08bade15b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d9 expref: 12 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.862100:0:8524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603000, rc 0) 00000100:00100000:1.0:1788940747.862185:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+12:12518:x1875839921792256:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 17854us (18630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940747.862194:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 72 00000100:00100000:0.0:1788940747.872252:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921792384 00000100:00100000:0.0:1788940747.872297:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921792384 00010000:00010000:0.0:1788940747.872372:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade154 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d2 expref: 12 pid: 8438 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940747.872447:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 100 00000100:00100000:0.0:1788940747.872462:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+12:2405:x1875839921792384:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940747.872484:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940747.872515:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade154 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d2 expref: 12 pid: 8438 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.872532:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade154 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d2 expref: 12 pid: 8438 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.872569:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade154 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d2 expref: 12 pid: 8438 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.872594:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940747.872599:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940747.872610:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08bade15b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d9 expref: 11 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.872623:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08bade15b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d9 expref: 11 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.872692:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08bade15b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d9 expref: 11 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940747.872741:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6507:1875839944922240:192.168.202.25@tcp:105: 00000100:00100000:0.0:1788940747.873081:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08715000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940747.886141:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6507:1875839944922240:192.168.202.25@tcp:105: 00010000:00010000:0.0:1788940747.886181:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940747.886240:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940747.886314:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82f3b232-46da-4a78-8599-45df2ddbced0+11:2405:x1875839921792384:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 13853us (25289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940747.886328:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 100 00000100:00100000:3.0:1788940747.887558:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921792512 00000100:00100000:3.0:1788940747.887570:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921792512 00002000:00100000:2.0:1788940747.887745:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff91cf06100700 x1875839921792512/t0(0) o4->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:723/0 lens 504/0 e 0 to 0 dl 1788940758 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788940747.887758:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91cf06100700 with x1875839921792512 ext(0->12) 00002000:00010000:2.0:1788940747.887764:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91cf06100700 00000100:00100000:2.0:1788940747.887824:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:2.0:1788940747.887834:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82f3b232-46da-4a78-8599-45df2ddbced0+11:2404:x1875839921792512:12345-192.168.202.25@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788940747.888884:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82f3b232-46da-4a78-8599-45df2ddbced0+13:2404:x1875839921792512:12345-192.168.202.25@tcp:4:lhsmtool_posix.0 Request processed in 1039us (2648us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788940747.888894:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 6 00002000:00100000:2.0:1788940747.888903:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff91cf06100700 x1875839921792512/t4294967321(0) o4->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:723/0 lens 504/448 e 0 to 0 dl 1788940758 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788940747.888912:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91cf06100700 with x1875839921792512 ext(0->12) 00002000:00010000:2.0:1788940747.888916:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91cf06100700 00000100:00100000:1.0:1788940747.891299:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940747.891431:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921792640 00000100:00100000:2.0:1788940747.891440:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921792640 00000100:00100000:2.0:1788940747.891482:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 244 00000100:00100000:2.0:1788940747.891490:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+73:12518:x1875839921792640:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788940747.893616:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:3.0:1788940747.893652:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00010000:00010000:1.0:1788940747.893667:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badde60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788940747.893712:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788940747.893750:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91cf08c30b40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788940747.893757:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91d02c35dd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91cf08c30f00 00000020:00080000:3.0:1788940747.893762:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91d02c35d200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91cf08cb0e00 00000004:00080000:3.0:1788940747.893798:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788940747.893838:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91cf08c30600 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788940747.893843:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91d019698700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91cf08c30c00 00000020:00080000:3.0:1788940747.893847:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91d019698a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91cf08cb1800 00000100:00100000:0.0:1788940747.893862:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944922368:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1788940747.893868:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1788940747.893914:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:0.0:1788940747.893961:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940747.894038:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944922368 00000020:00080000:3.0:1788940747.894042:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788940747.894047:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944922368 00000100:00100000:0.0:1788940747.894105:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788940747.894112:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875839944922368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788940747.894143:0:8438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:0.0:1788940747.894183:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa111ca, atime: 0x6aa111ca, ctime: 0x6aa111ca, blocks: 0x8 00010000:00010000:0.0:1788940747.894192:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071b5c39d/0x9c34acc08bade162 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.894210:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1788940747.894216:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940747.894223:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071b5c39d/0x9c34acc08bade162 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.894243:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071b5c39d/0x9c34acc08bade162 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.894292:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071b5c39d/0x9c34acc08bade162 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.894301:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071b5c39d/0x9c34acc08bade162 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.894322:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788940747.894480:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3647:x1875839944922368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 368us (519us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788940747.894487:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:0.0:1788940747.894525:0:10401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940747.894534:0:10401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071b5c39d/0x9c34acc08bade162 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.894545:0:10401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584d200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940747.894552:0:10401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071b5c39d/0x9c34acc08bade162 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940747.894560:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+27:12518:x1875839921792640:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 Request processed in 3059us (3294us total) trans 0 rc 0/0 00010000:00010000:0.0:1788940747.894566:0:10401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071b5c39d/0x9c34acc08bade162 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940747.894578:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 244 00010000:00010000:0.0:1788940747.894587:0:10401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071b5c39d/0x9c34acc08bade162 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.894599:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071b5c39d/0x9c34acc08bade162 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.894633:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940747.894636:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940747.894639:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788940747.894688:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91cf08d73b80/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788940747.894697:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944922368:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788940747.895474:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944922496:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788940747.895506:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940747.895540:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944922496 00000100:00100000:0.0:1788940747.895545:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944922496 00000100:00100000:0.0:1788940747.895570:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788940747.895575:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875839944922496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788940747.895590:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:0.0:1788940747.895607:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade169 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.895631:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08baddf16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7531 expref: 12 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.895641:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1788940747.895644:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940747.895647:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade169 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.895669:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08baddf16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7531 expref: 12 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.895712:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08baddf16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7531 expref: 12 pid: 8438 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940747.895724:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8437:1875839944922624:192.168.202.25@tcp:104: 00000100:00100000:0.0:1788940747.895767:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08715000 going to sleep for 11 seconds 00010000:00010000:1.0:1788940747.896187:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badde60 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896192:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badde60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896196:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940747.896271:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badde60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896287:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badde60 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896300:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91d0421d1300) 00010000:00010000:1.0:1788940747.896303:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940747.896307:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badde60 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896322:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7000/0x9c34acc08badde60 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896349:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddf08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896356:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddf08 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896363:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddf08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896368:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940747.896371:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddf08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896378:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddf08 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896386:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91cf06dfbe00) 00010000:00010000:1.0:1788940747.896388:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940747.896391:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddf08 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896407:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08baddf08 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896423:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896428:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf86 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896432:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896435:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940747.896436:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896440:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf86 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896445:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91cf07e65e00) 00010000:00010000:1.0:1788940747.896446:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940747.896448:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf86 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896452:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08baddf86 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896457:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddfa9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896461:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddfa9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896469:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddfa9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896472:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940747.896473:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddfa9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896477:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddfa9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896481:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91cf07e65e00) 00010000:00010000:1.0:1788940747.896482:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940747.896483:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddfa9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896486:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936e00/0x9c34acc08baddfa9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896497:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade07b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896503:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade07b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896509:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade07b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896514:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940747.896516:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade07b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896532:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade07b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896541:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:1.0:1788940747.896542:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940747.896544:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade07b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896548:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031c00/0x9c34acc08bade07b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896558:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade138 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896561:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade138 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896565:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade138 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896568:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584ca00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940747.896569:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade138 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896572:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade138 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896576:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91d0421d1e00) 00010000:00010000:1.0:1788940747.896578:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788940747.896579:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade138 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940747.896589:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ca00/0x9c34acc08bade138 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940747.905338:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940747.905414:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921792768 00000100:00100000:0.0:1788940747.905431:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921792768 00000100:00100000:0.0:1788940747.905507:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 75 00000100:00100000:0.0:1788940747.905518:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+13:2405:x1875839921792768:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788940747.907784:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8437:1875839944922624:192.168.202.25@tcp:104: 00010000:00010000:0.0:1788940747.907816:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade169 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940747.909365:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940747.910883:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921792896 00000100:00100000:3.0:1788940747.910899:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921792896 00010000:00010000:2.0:1788940747.911013:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08baddf16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7531 expref: 14 pid: 8438 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940747.911062:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 101 00000100:00100000:2.0:1788940747.911074:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+14:2404:x1875839921792896:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940747.911091:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940747.911098:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08baddf16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7531 expref: 14 pid: 8438 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.911117:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08baddf16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7531 expref: 14 pid: 8438 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.911138:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08baddf16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7531 expref: 14 pid: 8438 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.911154:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940747.911158:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940747.911162:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.911169:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade169 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.911202:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940747.911238:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.911248:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.911272:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.911288:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940747.911297:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+13:2404:x1875839921792896:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 225us (1939us total) trans 0 rc 0/0 00010000:00010000:3.0:1788940747.911302:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788940747.911305:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 101 00010000:00010000:0.0:1788940747.911383:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940747.911391:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.911399:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584de00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940747.911403:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.911413:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade169 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.911437:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade169 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.911444:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade169 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.911463:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940747.911465:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940747.911467:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940747.911544:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1875839944922496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15966us (16036us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788940747.911553:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:0.0:1788940747.911592:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91cf06101180/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788940747.911613:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944922496:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1788940747.913237:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:0.0:1788940747.913288:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:2.0:1788940747.915128:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921792768:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 Request processed in 9603us (9796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940747.915139:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 75 00000100:00100000:2.0:1788940747.919151:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940747.919295:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921793152 00000100:00100000:3.0:1788940747.919306:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921793152 00000100:00100000:3.0:1788940747.919377:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 245 00000100:00100000:3.0:1788940747.919387:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+21:12518:x1875839921793152:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788940747.919439:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940747.919464:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade14d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75cb expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.919482:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91d0421d1e00) 00010000:00010000:3.0:1788940747.919488:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940747.919519:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade170 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.919532:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade170 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.919542:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade170 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940747.919659:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2acaba2 reply state 0000000067e75cef transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade170 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.919694:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade170 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.919701:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91d0421d1e00) 00010000:00010000:3.0:1788940747.919704:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788940747.919707:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940747.919796:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+22:12518:x1875839921793152:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 410us (653us total) trans 4294967510 rc 0/0 00000100:00100000:3.0:1788940747.919803:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 245 00000100:00100000:2.0:1788940747.926586:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940747.926708:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921793280 00000100:00100000:0.0:1788940747.926718:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921793280 00000100:00100000:0.0:1788940747.926784:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 76 00000100:00100000:0.0:1788940747.926795:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+7:2406:x1875839921793280:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788940747.926934:0:8524:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788940747.926938:0:8524:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788940747 00002000:00010000:0.0:1788940747.926940:0:8524:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788940746 00002000:00010000:0.0:1788940747.926943:0:8524:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788940748 -> 1788940747 00002000:00010000:0.0:1788940747.926945:0:8524:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788940747.927003:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+8:2406:x1875839921793280:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 211us (427us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788940747.927009:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 76 00000100:00100000:1.0:1788940747.932722:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940747.932826:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921793536 00000100:00100000:2.0:1788940747.932835:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921793536 00000100:00100000:2.0:1788940747.932881:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 246 00000100:00100000:2.0:1788940747.932889:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+22:12518:x1875839921793536:12345-192.168.202.25@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788940747.932959:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade177 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.932978:0:8517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08bade131 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75bd expref: 22 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.932985:0:8517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade177 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.933014:0:8517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08bade131 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75bd expref: 22 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.933023:0:8517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08bade131 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75bd expref: 22 pid: 9713 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940747.933034:0:8517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037887100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944922752:192.168.202.25@tcp:104: 00000100:00100000:2.0:1788940747.933110:0:8517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c7f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788940747.942854:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940747.943485:0:8517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037887100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944922752:192.168.202.25@tcp:104: 00010000:00010000:2.0:1788940747.943512:0:8517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade177 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940747.943801:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921793664 00000100:00100000:0.0:1788940747.943809:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921793664 00010000:00010000:0.0:1788940747.943847:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08bade131 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75bd expref: 23 pid: 9713 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940747.943887:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 102 00000100:00100000:0.0:1788940747.943898:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+23:2405:x1875839921793664:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940747.943915:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940747.943922:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08bade131 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75bd expref: 23 pid: 9713 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.943934:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08bade131 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75bd expref: 23 pid: 9713 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.943956:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c200/0x9c34acc08bade131 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75bd expref: 23 pid: 9713 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.943972:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91d0421d1e00) 00010000:00010000:0.0:1788940747.943977:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade177 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.943987:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade177 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.943995:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade177 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.944023:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940747.944078:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+22:2405:x1875839921793664:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 181us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940747.944100:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 102 00010000:00010000:2.0:1788940747.944156:0:8517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade177 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.944164:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade177 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.944202:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade177 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.944210:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade177 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.944217:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade177 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.944223:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940747.944228:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade177 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.944246:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade177 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.944295:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91d0421d1e00) 00010000:00010000:2.0:1788940747.944299:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788940747.944303:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade177 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.944322:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade177 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940747.944362:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+21:12518:x1875839921793536:12345-192.168.202.25@tcp:55:lhsmtool_posix.0 Request processed in 11472us (11652us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788940747.944370:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 246 00000100:00100000:3.0:1788940747.948589:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940747.948690:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921793792 00000100:00100000:0.0:1788940747.948703:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921793792 00000100:00100000:0.0:1788940747.948759:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 77 00000100:00100000:0.0:1788940747.948769:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+8:2404:x1875839921793792:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788940747.948812:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade17e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.948833:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08bade15b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d9 expref: 8 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.948842:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940747.948846:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940747.948851:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade17e lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.948887:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08bade15b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d9 expref: 8 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.948901:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08bade15b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d9 expref: 8 pid: 8524 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940747.948915:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8437:1875839944922880:192.168.202.25@tcp:104: 00000100:00100000:0.0:1788940747.948993:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08715000 going to sleep for 11 seconds 00000100:00100000:1.0:1788940747.952720:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940747.952864:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921793920 00000100:00100000:3.0:1788940747.952872:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921793920 00010000:00010000:3.0:1788940747.952905:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08bade15b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d9 expref: 9 pid: 8524 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940747.952939:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 103 00000100:00100000:3.0:1788940747.952946:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+9:2404:x1875839921793920:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940747.952958:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940747.952976:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08bade15b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d9 expref: 9 pid: 8524 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.952987:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08bade15b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d9 expref: 9 pid: 8524 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.953011:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940747.953014:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940747.953034:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade17e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.953042:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade17e lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.953058:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940747.953105:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+9:2404:x1875839921793920:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 160us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940747.953110:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 103 00010000:00010000:0.0:1788940747.953206:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7465f99/0x9c34acc08bade15b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75d9 expref: 8 pid: 8524 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940747.953240:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8437:1875839944922880:192.168.202.25@tcp:104: 00010000:00010000:0.0:1788940747.953299:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade17e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.953311:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade17e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.953318:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade17e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.953339:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade17e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.953348:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade17e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.953357:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade17e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.953364:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584de00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940747.953368:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade17e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.953378:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade17e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.953396:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade17e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.953404:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005080dda1/0x9c34acc08bade17e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940747.953448:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+7:2404:x1875839921793792:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 Request processed in 4680us (4868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940747.953456:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 77 00000100:00100000:1.0:1788940747.957137:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940747.957220:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921794176 00000100:00100000:3.0:1788940747.957230:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921794176 00000100:00100000:3.0:1788940747.957323:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 247 00000100:00100000:3.0:1788940747.957333:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+21:12518:x1875839921794176:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788940747.957408:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade185 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.957427:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08bade074 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7585 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.957438:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade185 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.957472:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08bade074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7585 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.957488:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08bade074 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7585 expref: 21 pid: 6521 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940747.957523:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dced80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944923008:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788940747.957590:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788940747.959496:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dced80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944923008:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940747.959521:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade185 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940747.962443:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940747.962530:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921794304 00000100:00100000:0.0:1788940747.962540:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921794304 00010000:00010000:0.0:1788940747.962583:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08bade074 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7585 expref: 22 pid: 6521 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940747.962624:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 104 00000100:00100000:0.0:1788940747.962647:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+22:2405:x1875839921794304:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940747.962662:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940747.962684:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08bade074 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7585 expref: 22 pid: 6521 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.962702:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08bade074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7585 expref: 22 pid: 6521 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.962728:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08bade074 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7585 expref: 22 pid: 6521 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.962775:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:0.0:1788940747.962782:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08bade0d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75a8 expref: 21 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.962793:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade185 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.962801:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade185 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.962809:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade185 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940747.962894:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940747.962952:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+21:2405:x1875839921794304:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 307us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940747.962960:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 104 00010000:00010000:2.0:1788940747.963370:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade185 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.963380:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade185 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.963912:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade18c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.963925:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade13f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75c4 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.963934:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade18c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.963967:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade13f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75c4 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.963983:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade13f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75c4 expref: 21 pid: 6521 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940747.963999:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037887100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944923136:192.168.202.25@tcp:104: 00000100:00100000:2.0:1788940747.964066:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c7fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940747.978065:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940747.978139:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921794432 00000100:00100000:3.0:1788940747.978150:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921794432 00010000:00010000:3.0:1788940747.978192:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade13f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75c4 expref: 22 pid: 6521 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940747.978237:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 105 00000100:00100000:3.0:1788940747.978247:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0050da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+22:2404:x1875839921794432:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940747.978305:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940747.978320:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade13f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75c4 expref: 22 pid: 6521 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.978331:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade13f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75c4 expref: 22 pid: 6521 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.978350:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91d0421d1e00) 00010000:00010000:3.0:1788940747.978354:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade18c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.978362:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade18c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.978390:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade18c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.978419:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940747.978471:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0050da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82f3b232-46da-4a78-8599-45df2ddbced0+22:2404:x1875839921794432:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 226us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940747.978477:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 105 00010000:00010000:2.0:1788940747.979321:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade13f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75c4 expref: 21 pid: 6521 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940747.979338:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037887100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944923136:192.168.202.25@tcp:104: 00010000:00010000:2.0:1788940747.979358:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade18c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.979376:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade18c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.979382:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade18c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940747.979707:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788940747.979818:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:2.0:1788940747.979849:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788940747.979915:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037887100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1875839944923264:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788940747.979958:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940747.979988:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c7f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940747.980141:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944923264 00000100:00100000:1.0:1788940747.980147:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944923264 00000100:00100000:1.0:1788940747.980189:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788940747.980197:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1875839944923264:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788940747.980298:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1875839944923264:12345-0@lo:1000:mdt00_002.0 Request processed in 102us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940747.980306:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788940747.981224:0:6522:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:3.0:1788940747.981231:0:6522:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:3.0:1788940747.981281:0:6522:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff91cf06101180 x1875839944922496/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788940763 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940747.981294:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037887100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1875839944923264:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788940747.985177:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:2.0:1788940747.985435:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037887800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1875839944923392:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788940747.985550:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940747.985613:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c7fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940747.985717:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944923392 00000100:00100000:3.0:1788940747.985726:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944923392 00000100:00100000:3.0:1788940747.985781:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788940747.985791:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6522:x1875839944923392:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788940747.985905:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6522:x1875839944923392:12345-0@lo:1000:mdt00_002.0 Request processed in 114us (354us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788940747.985913:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788940747.985973:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037887800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1875839944923392:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788940747.986012:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade18c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.986024:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade18c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.986063:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade18c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.986082:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940747.986087:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade18c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.986096:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade18c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.986129:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91d0421d1e00) 00010000:00010000:2.0:1788940747.986133:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940747.986157:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade18c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.986179:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade18c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.986225:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08bade0cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.986475:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08bade0cf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.986496:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08bade0cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.986502:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d000031600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940747.986505:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08bade0cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.986532:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08bade0cf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.986559:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:2.0:1788940747.986562:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940747.986569:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08bade0d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75a8 expref: 24 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.986593:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08bade0d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75a8 expref: 24 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.986618:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08bade0d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75a8 expref: 24 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.986659:0:6522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08bade0d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75a8 expref: 24 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940747.986914:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037887b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944923520:192.168.202.25@tcp:105: 00000100:00100000:2.0:1788940747.987014:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c7fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940747.991168:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037887b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875839944923520:192.168.202.25@tcp:105: 00010000:00010000:2.0:1788940747.991220:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08bade0cf lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.991238:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031600/0x9c34acc08bade0cf lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.991315:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade193 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.991347:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade193 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.991360:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade193 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.991383:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade193 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.991389:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade193 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.991396:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade193 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.991402:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940747.991406:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade193 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.991414:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade193 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.991425:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:2.0:1788940747.991429:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940747.991432:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade193 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.991438:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade193 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.991449:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade185 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.991460:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade185 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.991467:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade185 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.991472:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940747.991475:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade185 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.991482:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade185 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.991491:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:2.0:1788940747.991494:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788940747.991497:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade185 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940747.991503:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade185 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940747.991691:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+24:12518:x1875839921794176:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 34358us (34561us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788940747.991702:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 247 00000020:00080000:2.0:1788940747.991710:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788940747.993980:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940747.993989:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940747.995411:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788940747.995424:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788940747.998374:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940747.998413:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940747.998546:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921794688 00000100:00100000:2.0:1788940747.998558:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921794688 00000100:00100000:3.0:1788940747.998603:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921794816 00000100:00100000:3.0:1788940747.998608:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921794816 00000100:00100000:3.0:1788940747.998644:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 61 00000100:00100000:3.0:1788940747.998654:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+25:12518:x1875839921794688:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788940747.999118:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788940747.999152:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:3.0:1788940747.999202:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade19a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.999221:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade19a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.999234:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade19a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.999243:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade19a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.999249:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade19a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.999277:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade19a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940747.999351:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788940747.999446:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+27:12518:x1875839921794688:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 791us (1079us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788940747.999454:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 61 00000020:00080000:3.0:1788940747.999459:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788940747.999476:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 62 00000100:00100000:3.0:1788940747.999483:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d002e61450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+26:12517:x1875839921794816:12345-192.168.202.25@tcp:49:lfs.0 00000100:00100000:3.0:1788940747.999547:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d002e61450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+26:12517:x1875839921794816:12345-192.168.202.25@tcp:49:lfs.0 Request processed in 64us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940747.999554:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 62 00010000:00010000:0.0:1788940748.003409:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940748.003423:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade19a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.003435:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940748.003457:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade19a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.003467:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade19a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.003486:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91d0421d1e00) 00010000:00010000:0.0:1788940748.003489:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788940748.003494:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade19a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.003501:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08bade19a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.003517:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940748.003519:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940748.003521:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940748.003963:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940748.004318:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921795072 00000100:00100000:0.0:1788940748.004329:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921795072 00000100:00080000:1.0:1788940748.004470:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940748.004611:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 248 00000100:00100000:0.0:1788940748.004620:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+26:12517:x1875839921795072:12345-192.168.202.25@tcp:58:lfs.0 00000040:00080000:0.0:1788940748.005007:0:9713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788940748.005086:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+26:12517:x1875839921795072:12345-192.168.202.25@tcp:58:lfs.0 Request processed in 467us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940748.005094:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 248 00000100:00100000:1.0:1788940748.073149:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940748.073361:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921795200 00000100:00100000:2.0:1788940748.073373:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921795200 00000100:00100000:2.0:1788940748.073660:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 249 00000100:00100000:2.0:1788940748.073703:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+26:12520:x1875839921795200:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1788940748.073730:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940748.073751:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade1a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc75e0 expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.073822:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade1a8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.073839:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade1a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.073851:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade1a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.073866:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08bade1af lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.073874:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08bade1af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.073881:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08bade1af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.073967:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08bade1b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.073978:0:8517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08bade0c1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75a1 expref: 27 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.073986:0:8517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08bade1b6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.074031:0:8517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08bade0c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75a1 expref: 27 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940748.074043:0:8517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08bade0c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75a1 expref: 27 pid: 8517 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940748.074056:0:8517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037887b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944923648:192.168.202.25@tcp:104: 00000100:00100000:2.0:1788940748.074145:0:8517:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c7fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940748.079776:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940748.079898:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921795456 00000100:00100000:3.0:1788940748.079907:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921795456 00000100:00100000:3.0:1788940748.079963:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 63 00000100:00100000:3.0:1788940748.079970:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+28:6189:x1875839921795456:12345-192.168.202.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788940748.080149:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+29:6189:x1875839921795456:12345-192.168.202.25@tcp:35:ldlm_bl.0 Request processed in 179us (383us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788940748.080154:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 63 00000100:00100000:2.0:1788940748.083146:0:8517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037887b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8517:1875839944923648:192.168.202.25@tcp:104: 00010000:00010000:2.0:1788940748.083172:0:8517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08bade1b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940748.092377:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940748.092534:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921795584 00000100:00100000:0.0:1788940748.092545:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921795584 00010000:00010000:0.0:1788940748.092593:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08bade0c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75a1 expref: 29 pid: 8517 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940748.092641:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 106 00000100:00100000:0.0:1788940748.092666:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+29:2405:x1875839921795584:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940748.092701:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940748.092710:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08bade0c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75a1 expref: 29 pid: 8517 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.092726:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08bade0c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75a1 expref: 29 pid: 8517 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.092749:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08bade0c1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75a1 expref: 29 pid: 8517 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.092767:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:0.0:1788940748.092773:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08bade1b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.092783:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08bade1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.092792:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08bade1b6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940748.092826:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940748.092880:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82f3b232-46da-4a78-8599-45df2ddbced0+28:2405:x1875839921795584:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 216us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940748.092887:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 106 00010000:00010000:3.0:1788940748.092915:0:8517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08bade1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.092926:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08bade1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940748.092993:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788940748.092999:0:8517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940748.093021:0:8517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08bade1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.093037:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08bade1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.093047:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade1a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.093054:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade1a8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.093062:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade1a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.093069:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940748.093074:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade1a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.093094:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade1a8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.093105:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:3.0:1788940748.093108:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940748.093112:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade1a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.093118:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade1a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.093129:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08bade1af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.093134:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08bade1af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.093140:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08bade1af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.093145:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940748.093148:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08bade1af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.093154:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08bade1af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.093161:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91d03ed37b00) 00010000:00010000:3.0:1788940748.093163:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940748.093166:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08bade1af lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.093181:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6800/0x9c34acc08bade1af lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.093217:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6a00/0x9c34acc08bade1a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75e0 expref: 28 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.093237:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08bade1b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75e0 expref: 27 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940748.093245:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:3.0:1788940748.093247:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940748.093250:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e6000, rc 0) 00000100:00100000:3.0:1788940748.093314:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+27:12520:x1875839921795200:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 19615us (20177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940748.093322:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 249 00010000:00010000:0.0:1788940748.124831:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940748.446549:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944923776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788940748.446614:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940748.446792:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944923776 00000100:00100000:1.0:1788940748.446800:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944923776 00000100:00100000:1.0:1788940748.446850:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788940748.446859:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944923776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788940748.446892:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788940748.449960:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944923776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3095us (3338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940748.449974:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788940748.450093:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944923776:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788940748.625482:0:14715:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940748.625492:0:14715:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940748.625523:0:14715:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788940748.625528:0:14715:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788940749.019500:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940749.019510:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940749.019532:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788940749.019552:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788940749.019804:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d09c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1875839944923904:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788940749.019920:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08715480 going to sleep for 11 seconds 00000100:00100000:3.0:1788940749.029052:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d09c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13806:1875839944923904:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788940749.030882:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940749.031141:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921795712 00000100:00100000:2.0:1788940749.031150:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921795712 00000100:00100000:2.0:1788940749.031213:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 250 00000100:00100000:2.0:1788940749.031229:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+27:12532:x1875839921795712:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788940749.031292:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788940749.031401:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+27:12532:x1875839921795712:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 179us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940749.031408:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 250 00000100:00100000:0.0:1788940749.039148:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940749.039358:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921795968 00000100:00100000:3.0:1788940749.039368:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921795968 00000100:00100000:3.0:1788940749.039422:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 251 00000100:00100000:3.0:1788940749.039443:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+27:12532:x1875839921795968:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940749.039463:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940749.039482:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218200/0x9c34acc08bade1bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc75e7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940749.039586:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219e00/0x9c34acc08bade1c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940749.039601:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219e00/0x9c34acc08bade1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940749.039614:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219e00/0x9c34acc08bade1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940749.039625:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788940749.039877:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218200/0x9c34acc08bade1bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75e7 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940749.039895:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219e00/0x9c34acc08bade1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75e7 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940749.039904:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:3.0:1788940749.039906:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940749.039910:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219e00, rc 0) 00000100:00100000:3.0:1788940749.039967:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+29:12532:x1875839921795968:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 525us (829us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788940749.039974:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 251 00000100:00100000:1.0:1788940749.043001:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940749.043163:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921796096 00000100:00100000:2.0:1788940749.043173:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921796096 00000100:00100000:2.0:1788940749.043239:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:2.0:1788940749.043248:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+29:2405:x1875839921796096:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940749.043446:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940749.043481:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219e00/0x9c34acc08bade1c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75e7 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940749.043499:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:2.0:1788940749.043504:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940749.043634:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82f3b232-46da-4a78-8599-45df2ddbced0+28:2405:x1875839921796096:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 387us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940749.043642:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:1.0:1788940749.051564:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940749.051795:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921796352 00000100:00100000:3.0:1788940749.051805:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921796352 00000100:00100000:3.0:1788940749.051881:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 252 00000100:00100000:3.0:1788940749.051892:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+28:12532:x1875839921796352:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788940749.051971:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218200/0x9c34acc08bade1d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940749.051988:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218200/0x9c34acc08bade1d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940749.052000:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218200/0x9c34acc08bade1d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940749.052146:0:8517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218200/0x9c34acc08bade1d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940749.052154:0:8517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218200/0x9c34acc08bade1d2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940749.052161:0:8517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218200/0x9c34acc08bade1d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940749.052167:0:8517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940749.052171:0:8517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218200/0x9c34acc08bade1d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940749.052180:0:8517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218200/0x9c34acc08bade1d2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940749.052425:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:3.0:1788940749.052429:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788940749.052435:0:8517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218200/0x9c34acc08bade1d2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940749.052453:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218200/0x9c34acc08bade1d2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940749.052568:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+29:12532:x1875839921796352:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 678us (1013us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788940749.052577:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 252 00000040:00080000:0.0:1788940749.056464:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940749.056473:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788940749.062441:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940749.063763:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921796608 00000100:00100000:2.0:1788940749.063774:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921796608 00000100:00100000:2.0:1788940749.063832:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:2.0:1788940749.063843:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+29:12532:x1875839921796608:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788940749.064081:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+30:12532:x1875839921796608:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 239us (1651us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788940749.064089:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 64 00000040:00080000:0.0:1788940749.066138:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788940749.066152:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788940749.147606:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940749.467989:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944924160:0@lo:400:kworker.0 00000100:00100000:2.0:1788940749.468058:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940749.468106:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940749.468112:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944924416:0@lo:400:kworker.0 00000100:00100000:2.0:1788940749.468138:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940749.468165:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944924160 00000100:00100000:2.0:1788940749.468173:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944924160 00000100:00100000:2.0:1788940749.468218:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1788940749.468231:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944924160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940749.468253:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944924288:0@lo:400:kworker.0 00000100:00100000:2.0:1788940749.468293:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944924160:12345-0@lo:400:kworker.0 Request processed in 65us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940749.468315:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940749.468324:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1788940749.468346:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944924800:0@lo:400:kworker.0 00000100:00100000:2.0:1788940749.468361:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944924544:0@lo:400:kworker.0 00000100:00100000:0.0:1788940749.468374:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940749.468472:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839944925312:0@lo:400:kworker.0 00000100:00100000:0.0:1788940749.468496:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940749.468577:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944924416 00000100:00100000:1.0:1788940749.468582:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944924416 00000100:00100000:1.0:1788940749.468613:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788940749.468634:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944924416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940749.468684:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944924416:12345-0@lo:400:kworker.0 Request processed in 52us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940749.468691:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788940749.468985:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788940749.468993:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944924032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940749.469082:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940749.469099:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944924672:0@lo:400:kworker.0 00000100:00100000:0.0:1788940749.469120:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940749.469134:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944925184:0@lo:400:kworker.0 00000100:00100000:0.0:1788940749.469156:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940749.469173:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944925696:0@lo:400:kworker.0 00000100:00100000:0.0:1788940749.469193:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940749.469298:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940749.469308:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944925824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940749.469335:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940749.469357:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944924928:0@lo:400:kworker.0 00000100:00100000:1.0:1788940749.469507:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944924032 00000100:00100000:1.0:1788940749.469512:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944924032 00000100:00100000:1.0:1788940749.469547:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944925824 00000100:00100000:1.0:1788940749.469550:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944925824 00000100:00100000:1.0:1788940749.469565:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788940749.469572:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944924032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788940749.469595:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940749.469639:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944924032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940749.469645:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788940749.469685:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788940749.469693:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875839944925824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940749.469703:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940749.469731:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875839944925824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940749.469745:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788940749.469775:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944924672 00000100:00100000:1.0:1788940749.469779:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944924672 00000100:00100000:1.0:1788940749.469800:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788940749.469805:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944924672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940749.469835:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944924672:12345-0@lo:400:kworker.0 Request processed in 30us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940749.469841:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:1.0:1788940749.469863:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940749.469896:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944925824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940749.470137:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944925184 00000100:00100000:1.0:1788940749.470142:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944925184 00000100:00100000:1.0:1788940749.470170:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944925696 00000100:00100000:1.0:1788940749.470174:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944925696 00000100:00100000:1.0:1788940749.470191:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788940749.470197:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1875839944925184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940749.470230:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1875839944925184:12345-0@lo:400:kworker.0 Request processed in 33us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940749.470236:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788940749.470247:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788940749.470253:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1875839944925696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940749.470296:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1875839944925696:12345-0@lo:400:kworker.0 Request processed in 43us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940749.470302:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1788940749.470319:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940749.470893:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940749.489993:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944924288 00000100:00100000:2.0:1788940749.490010:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944924288 00000100:00100000:2.0:1788940749.490081:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944924800 00000100:00100000:2.0:1788940749.490084:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944924800 00000100:00100000:2.0:1788940749.490119:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944925312 00000100:00100000:2.0:1788940749.490122:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944925312 00000100:00100000:2.0:1788940749.490141:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1788940749.490150:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944924288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940749.490235:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944924288:12345-0@lo:400:kworker.0 Request processed in 86us (21923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940749.490242:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1788940749.490271:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1788940749.490276:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944924800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940749.490302:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944924800:12345-0@lo:400:kworker.0 Request processed in 26us (21929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940749.490307:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1788940749.490318:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1788940749.490323:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839944925312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940749.490345:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839944925312:12345-0@lo:400:kworker.0 Request processed in 21us (21848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940749.490350:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00080000:2.0:1788940749.490375:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940749.490430:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944924032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940749.490460:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944924672:0@lo:400:kworker.0 00000100:00100000:2.0:1788940749.490471:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944925184:0@lo:400:kworker.0 00000100:00100000:2.0:1788940749.490483:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944925696:0@lo:400:kworker.0 00000100:00100000:2.0:1788940749.490493:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944924288:0@lo:400:kworker.0 00000100:00100000:2.0:1788940749.490503:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944924800:0@lo:400:kworker.0 00000100:00100000:2.0:1788940749.490512:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839944925312:0@lo:400:kworker.0 00000100:00100000:3.0:1788940749.496600:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944925440:0@lo:400:kworker.0 00000100:00100000:3.0:1788940749.496689:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940749.496720:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944924928 00000100:00100000:3.0:1788940749.496728:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944924928 00000100:00100000:3.0:1788940749.496793:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944925440 00000100:00100000:3.0:1788940749.496797:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944925440 00000100:00100000:3.0:1788940749.496822:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1788940749.496831:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944924928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940749.496880:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944924928:12345-0@lo:400:kworker.0 Request processed in 50us (25987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940749.496888:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1788940749.496905:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1788940749.496911:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944925440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940749.497170:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944925440:12345-0@lo:400:kworker.0 Request processed in 259us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940749.497177:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00080000:3.0:1788940749.497198:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788940749.497225:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08d0bb80 x1875839944925440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940749.497239:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944925440:0@lo:400:kworker.0 00010000:00080000:3.0:1788940749.497278:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08d0b800 x1875839944924928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940749.497288:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944924928:0@lo:400:kworker.0 00000100:00100000:0.0:1788940749.498738:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940749.498785:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944925056:0@lo:400:kworker.0 00000100:00100000:0.0:1788940749.498831:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940749.498858:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944925568:0@lo:400:kworker.0 00000100:00100000:0.0:1788940749.498879:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940749.498915:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944924416:0@lo:400:kworker.0 00000100:00100000:0.0:1788940749.498941:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944924160:0@lo:400:kworker.0 00000100:00100000:0.0:1788940749.498990:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944924544 00000100:00100000:2.0:1788940749.499122:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944925056 00000100:00100000:2.0:1788940749.499128:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944925056 00000100:00100000:2.0:1788940749.499167:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944925568 00000100:00100000:2.0:1788940749.499170:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944925568 00000100:00100000:2.0:1788940749.499188:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788940749.499195:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944925056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940749.499244:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944925056:12345-0@lo:400:kworker.0 Request processed in 50us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940749.499251:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788940749.499291:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788940749.499298:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944925568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940749.499323:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944925568:12345-0@lo:400:kworker.0 Request processed in 27us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940749.499329:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788940749.499521:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944924544 00000100:00100000:0.0:1788940749.499542:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944925056:0@lo:400:kworker.0 00000100:00100000:0.0:1788940749.499552:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944925568:0@lo:400:kworker.0 00000100:00100000:0.0:1788940749.499599:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1788940749.499606:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944924544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940749.499652:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944924544:12345-0@lo:400:kworker.0 Request processed in 46us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940749.499668:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1788940749.499692:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944924544:0@lo:400:kworker.0 00000100:00080000:3.0:1788940749.502878:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788940750.186134:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940751.002965:0:14766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940751.002978:0:14766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940751.003019:0:14766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788940751.003026:0:14766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788940751.199283:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940751.330397:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940751.332670:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921796864 00000100:00100000:0.0:1788940751.332696:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921796864 00000100:00100000:0.0:1788940751.332855:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 253 00000100:00100000:0.0:1788940751.332869:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+30:12553:x1875839921796864:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1788940751.332923:0:9713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940751.332952:0:9713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08bade1d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc75ee expref: -99 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940751.333127:0:9713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08bade1e0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940751.333146:0:9713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08bade1e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940751.333162:0:9713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08bade1e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940751.333175:0:9713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788940751.333376:0:9713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08bade1d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75ee expref: 33 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940751.333395:0:9713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08bade1e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75ee expref: 32 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940751.333404:0:9713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:0.0:1788940751.333407:0:9713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788940751.333411:0:9713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584d200, rc 0) 00000100:00100000:0.0:1788940751.333497:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+32:12553:x1875839921796864:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 631us (3113us total) trans 4294967522 rc 0/0 00000100:00080000:2.0:1788940751.340924:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940751.341100:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 253 00000100:00100000:2.0:1788940751.342567:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940751.342668:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921796992 00000100:00100000:3.0:1788940751.342682:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921796992 00000100:00100000:3.0:1788940751.342760:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 254 00000100:00100000:3.0:1788940751.342771:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+32:12553:x1875839921796992:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:3.0:1788940751.342868:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade1ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940751.342892:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade1ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940751.342908:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade1ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940751.342959:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade1ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940751.343051:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade1ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940751.343059:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade1ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940751.343066:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940751.343072:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade1ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940751.343081:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade1ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940751.343106:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:3.0:1788940751.343110:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788940751.343117:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade1ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940751.343125:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade1ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940751.343219:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+32:12553:x1875839921796992:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 448us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940751.343227:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 254 00000100:00100000:2.0:1788940751.518042:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940751.518391:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921797120 00000100:00100000:3.0:1788940751.518406:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921797120 00000100:00100000:3.0:1788940751.518488:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 78 00000100:00100000:3.0:1788940751.518502:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921797120:12345-192.168.202.25@tcp:101:cat.0 00010000:00010000:3.0:1788940751.518529:0:8524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940751.518562:0:8524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc990318/0x9c34acc08bade1f5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc75f5 expref: -99 pid: 8524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940751.518595:0:8524:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa111cb, atime: 0x6aa111ca, ctime: 0x6aa111cb, blocks: 0x8 00010000:00010000:3.0:1788940751.518622:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1788940751.518627:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940751.518648:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc990318/0x9c34acc08bade1f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75f5 expref: 8 pid: 8524 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940751.518670:0:8524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cc990318/0x9c34acc08bade1f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75f5 expref: 8 pid: 8524 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940751.518684:0:8524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001218600, rc 0) 00000100:00100000:3.0:1788940751.518756:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+8:2405:x1875839921797120:12345-192.168.202.25@tcp:101:cat.0 Request processed in 257us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940751.518764:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 78 00000100:00080000:2.0:1788940751.519405:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788940751.525148:0:9517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:3.0:1788940751.537473:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940751.537511:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921797248 00000100:00100000:3.0:1788940751.537524:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921797248 00002000:00100000:3.0:1788940751.537590:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff91cf08dd2680 x1875839921797248/t0(0) o3->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:727/0 lens 488/0 e 0 to 0 dl 1788940762 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788940751.537599:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91cf08dd2680 with x1875839921797248 ext(0->4095) 00002000:00010000:3.0:1788940751.537606:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91cf08dd2680 00000100:00100000:3.0:1788940751.537632:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:3.0:1788940751.537662:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82f3b232-46da-4a78-8599-45df2ddbced0+8:2404:x1875839921797248:12345-192.168.202.25@tcp:3:cat.0 00000100:00100000:3.0:1788940751.537877:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82f3b232-46da-4a78-8599-45df2ddbced0+8:2404:x1875839921797248:12345-192.168.202.25@tcp:3:cat.0 Request processed in 216us (416us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788940751.537904:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00002000:00100000:3.0:1788940751.537912:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff91cf08dd2680 x1875839921797248/t0(0) o3->82f3b232-46da-4a78-8599-45df2ddbced0@192.168.202.25@tcp:727/0 lens 488/4536 e 0 to 0 dl 1788940762 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788940751.537921:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91cf08dd2680 with x1875839921797248 ext(0->4095) 00002000:00010000:3.0:1788940751.537924:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91cf08dd2680 00000100:00100000:3.0:1788940752.027747:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944925952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940752.027864:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940752.028289:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944925952 00000100:00100000:1.0:1788940752.028318:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944925952 00000100:00100000:1.0:1788940752.028392:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788940752.028402:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944925952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788940752.028446:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788940752.028592:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944925952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 189us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940752.028600:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788940752.029037:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944925952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940752.170815:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940752.170938:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940752.170989:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940752.171019:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940752.171044:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940752.171290:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940752.171338:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940752.171377:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921797632 00000100:00100000:3.0:1788940752.171391:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921797632 00000100:00100000:3.0:1788940752.171466:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921798144 00000100:00100000:3.0:1788940752.171470:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921798144 00000100:00100000:3.0:1788940752.171485:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921797504 00000100:00100000:3.0:1788940752.171488:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921797504 00000100:00100000:3.0:1788940752.171499:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921798016 00000100:00100000:3.0:1788940752.171501:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921798016 00000100:00100000:3.0:1788940752.171699:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 402 00000100:00100000:3.0:1788940752.171712:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921797632:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940752.171813:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921797632:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 104us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940752.171841:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 402 00000100:00100000:0.0:1788940752.175216:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921797888 00000100:00100000:0.0:1788940752.175241:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921797888 00000100:00100000:0.0:1788940752.175363:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921797760 00000100:00100000:0.0:1788940752.175386:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921797760 00000100:00100000:0.0:1788940752.175428:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 156 00000100:00100000:0.0:1788940752.175441:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921797888:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940752.176113:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921797888:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 618us (5066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940752.176124:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 156 00000100:00100000:0.0:1788940752.176150:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 157 00000100:00100000:0.0:1788940752.176159:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+8:2405:x1875839921797760:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940752.176191:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+8:2405:x1875839921797760:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 34us (4937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940752.176198:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 157 00000100:00100000:1.0:1788940752.180763:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921797376 00000100:00100000:1.0:1788940752.180791:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921797376 00000100:00100000:1.0:1788940752.181338:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 407 00000100:00100000:1.0:1788940752.181354:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2405:x1875839921797376:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940752.181455:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2405:x1875839921797376:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 105us (10655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940752.181462:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 407 00000100:00100000:2.0:1788940752.181842:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 403 00000100:00080000:2.0:1788940752.181874:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940752.181883:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940752.181886:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788940752.181903:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921798144:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940752.181945:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921798144:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 94us (10925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940752.181953:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 403 00000100:00100000:2.0:1788940752.181975:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 404 00000100:00100000:2.0:1788940752.181983:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+32:2405:x1875839921797504:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940752.182015:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+32:2405:x1875839921797504:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 32us (10970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940752.182022:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 404 00000100:00100000:2.0:1788940752.182035:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 405 00000100:00100000:2.0:1788940752.182042:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921798016:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940752.182069:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921798016:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 28us (10731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940752.182075:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 405 00010000:00010000:0.0:1788940752.219645:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788940752.541084:0:8523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 507873823884ns, next at 508873820274ns, rc = 0 00000100:00100000:0.0:1788940752.541182:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944926080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940752.541278:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940752.541411:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944926080 00000100:00100000:3.0:1788940752.541418:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944926080 00000100:00100000:3.0:1788940752.541638:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788940752.541663:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875839944926080:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940752.541688:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944926208:0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788940752.541793:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788940752.541844:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875839944926080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 188us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940752.541853:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:0.0:1788940752.542071:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940752.542108:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944926080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940752.542646:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940752.542805:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944926208 00000100:00100000:2.0:1788940752.542812:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944926208 00000100:00100000:2.0:1788940752.542866:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788940752.542875:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944926208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788940752.542889:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:0.0:1788940752.543020:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940752.545853:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944926208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2970us (3200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940752.546146:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788940752.546312:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944926208:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788940753.245910:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940753.590981:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944926336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788940753.591053:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940753.600850:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944926336 00000100:00100000:0.0:1788940753.600873:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944926336 00000100:00100000:0.0:1788940753.601029:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788940753.601041:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944926336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788940753.601092:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788940753.601181:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944926336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (10127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940753.601201:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788940753.602365:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944926336:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1788940753.604714:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1788940753.604729:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000004:00080000:2.0:1788940753.604894:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000001:00080000:2.0:1788940753.604922:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1788940753.604942:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91cf08c7fc00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788940753.604947:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91d00361d300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91cf08c7f540 00000020:00080000:2.0:1788940753.604950:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91d003fdfb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91cf07fdea00 00000020:00080000:2.0:1788940753.604966:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788940753.604975:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788940753.605033:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1788940753.605070:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade170 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940753.605081:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade170 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940753.605089:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade170 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940753.605105:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940753.605109:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade170 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940753.605117:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade170 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940753.605131:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91d0421d1e00) 00010000:00010000:1.0:1788940753.605133:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940753.605138:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade170 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940753.605144:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218e00/0x9c34acc08bade170 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940753.606395:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940753.607703:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944926464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788940753.611049:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940753.611603:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944926464 00000100:00100000:1.0:1788940753.611618:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944926464 00000100:00100000:1.0:1788940753.611697:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788940753.611709:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944926464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788940753.611900:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788940753.611904:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788940747 -> 1788940747 00002000:00010000:1.0:1788940753.611907:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 1788940746 -> 1788940746 00002000:00010000:1.0:1788940753.611909:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788940747 -> 1788940747 00002000:00010000:1.0:1788940753.611912:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788940753.611970:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875839944926464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 263us (928us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788940753.611994:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788940753.612041:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788940753.612047:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91cf06101180, transno 4294967322 00000004:00080000:1.0:1788940753.612057:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788940753.612081:0:3646:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff91cf0610ad80 x1875839944926464/t4294967325(4294967325) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788940769 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788940753.612093:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91cf0610ad80/2, rc 0, transno 4294967325 00000100:00100000:1.0:1788940753.612098:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944926464:0@lo:2:osp-syn-0-0.0 00000040:00080000:0.0:1788940754.203470:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940754.203485:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940754.203513:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788940754.203545:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788940754.268026:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940754.587708:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944926592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940754.587800:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788940754.588056:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788940754.588447:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944926976:0@lo:400:kworker.0 00000100:00100000:2.0:1788940754.588485:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940754.588506:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944927488:0@lo:400:kworker.0 00000100:00100000:2.0:1788940754.588529:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940754.588551:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944928000:0@lo:400:kworker.0 00000100:00100000:2.0:1788940754.588587:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940754.588697:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944926720:0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.588734:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940754.588759:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944927232:0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.588795:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940754.588810:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944927744:0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.588836:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940754.588851:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944928256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940754.588882:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940754.588903:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788940754.588915:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944926848:0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.588942:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940754.588965:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944927360:0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.588995:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940754.589018:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944927872:0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.589049:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940754.589093:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944926976 00000100:00100000:0.0:1788940754.589130:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944926976 00000100:00100000:0.0:1788940754.589196:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944927232 00000100:00100000:0.0:1788940754.589200:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944927232 00000100:00100000:0.0:1788940754.589216:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788940754.589224:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944926976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.589312:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944926976:12345-0@lo:400:kworker.0 Request processed in 88us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940754.589320:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788940754.589337:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788940754.589343:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944927232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.589376:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944927232:12345-0@lo:400:kworker.0 Request processed in 32us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940754.589382:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788940754.589398:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944927744 00000100:00100000:0.0:1788940754.589402:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944927744 00000100:00100000:0.0:1788940754.589446:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788940754.589452:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1875839944927744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.589486:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1875839944927744:12345-0@lo:400:kworker.0 Request processed in 34us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940754.589492:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788940754.589508:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944927488 00000100:00100000:0.0:1788940754.589516:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944927488 00000100:00100000:0.0:1788940754.589542:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944928000 00000100:00100000:0.0:1788940754.589548:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944928000 00000100:00100000:0.0:1788940754.589562:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944926848 00000100:00100000:0.0:1788940754.589564:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944926848 00000100:00100000:0.0:1788940754.589573:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944927360 00000100:00100000:0.0:1788940754.589575:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944927360 00000100:00100000:0.0:1788940754.589585:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944927872 00000100:00100000:0.0:1788940754.589593:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944927872 00000100:00100000:0.0:1788940754.589608:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1788940754.589631:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944927488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.589664:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944927488:12345-0@lo:400:kworker.0 Request processed in 35us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940754.589670:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1788940754.589680:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1788940754.589686:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944928000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.589710:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944928000:12345-0@lo:400:kworker.0 Request processed in 25us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940754.589716:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1788940754.589725:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1788940754.589731:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944926848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.589752:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944926848:12345-0@lo:400:kworker.0 Request processed in 22us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940754.589758:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1788940754.589776:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1788940754.589782:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944927360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.589808:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944927360:12345-0@lo:400:kworker.0 Request processed in 27us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940754.589818:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1788940754.589828:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:0.0:1788940754.589833:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944927872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.589857:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944927872:12345-0@lo:400:kworker.0 Request processed in 25us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940754.589871:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00080000:0.0:1788940754.589891:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940754.589900:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788940754.589902:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940754.589936:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944926848:0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.589949:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944927360:0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.589961:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944927872:0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.589971:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944927232:0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.589980:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944927744:0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.590063:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944926720 00000100:00100000:0.0:1788940754.590067:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944926720 00000100:00100000:0.0:1788940754.590093:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1788940754.590100:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944926720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940754.590152:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944926720:12345-0@lo:400:kworker.0 Request processed in 53us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940754.590162:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1788940754.590193:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944926720:0@lo:400:kworker.0 00000100:00100000:2.0:1788940754.590465:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788940754.590478:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944927104:0@lo:400:kworker.0 00000100:00100000:2.0:1788940754.590505:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940754.590531:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944927616:0@lo:400:kworker.0 00000100:00100000:2.0:1788940754.590561:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940754.590582:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944928128:0@lo:400:kworker.0 00000100:00100000:2.0:1788940754.590598:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940754.590629:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944926976:0@lo:400:kworker.0 00010000:00080000:2.0:1788940754.590657:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08d09500 x1875839944927488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940754.590670:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944927488:0@lo:400:kworker.0 00010000:00080000:2.0:1788940754.590683:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08d09880 x1875839944928000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940754.590693:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944928000:0@lo:400:kworker.0 00000100:00100000:1.0:1788940754.590801:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944927616 00000100:00100000:1.0:1788940754.590806:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944927616 00000100:00100000:1.0:1788940754.590849:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944928128 00000100:00100000:1.0:1788940754.590853:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944928128 00000100:00100000:1.0:1788940754.590871:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788940754.590879:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944927616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940754.590931:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944927616:12345-0@lo:400:kworker.0 Request processed in 54us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940754.590946:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788940754.590964:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788940754.590974:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944928128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940754.591000:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944928128:12345-0@lo:400:kworker.0 Request processed in 30us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940754.591006:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788940754.591096:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944926592 00000100:00100000:3.0:1788940754.591102:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944926592 00000100:00100000:3.0:1788940754.591141:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944928256 00000100:00100000:3.0:1788940754.591145:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944928256 00000100:00100000:3.0:1788940754.591158:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788940754.591166:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944926592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940754.591204:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940754.591250:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944926592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (3450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940754.591308:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788940754.591321:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788940754.591327:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944928256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788940754.591335:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940754.591364:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944928256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (2484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940754.591381:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788940754.591398:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944927104 00000100:00100000:3.0:1788940754.591402:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944927104 00000100:00100000:3.0:1788940754.591424:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1788940754.591430:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944927104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940754.591467:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944927104:12345-0@lo:400:kworker.0 Request processed in 37us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940754.591473:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1788940754.591508:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1788940754.591515:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1788940754.591533:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91cf08d73b80, transno 4294967311 00000100:00100000:3.0:1788940754.591558:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944926592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940754.591697:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944928256:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788940754.592469:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940754.592475:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940754.592500:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944927104:0@lo:400:kworker.0 00000100:00100000:2.0:1788940754.592513:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944927616:0@lo:400:kworker.0 00000100:00100000:2.0:1788940754.592522:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944928128:0@lo:400:kworker.0 00010000:00010000:0.0:1788940755.291847:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940756.315518:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940757.148204:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944928384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940757.148332:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940757.150343:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944928384 00000100:00100000:1.0:1788940757.150385:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944928384 00000100:00100000:1.0:1788940757.150583:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788940757.150605:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944928384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788940757.150655:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788940757.150762:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944928384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 160us (2429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940757.150770:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788940757.150853:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944928384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940757.285677:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940757.285747:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940757.285796:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940757.285834:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940757.285876:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940757.285917:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921798528 00000100:00100000:3.0:1788940757.285932:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921798528 00000100:00100000:3.0:1788940757.286011:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921799040 00000100:00100000:3.0:1788940757.286015:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921799040 00000100:00100000:3.0:1788940757.286036:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921798400 00000100:00100000:3.0:1788940757.286039:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921798400 00000100:00100000:3.0:1788940757.286061:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 412 00000100:00100000:3.0:1788940757.286075:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921798528:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940757.286320:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921798272 00000100:00100000:2.0:1788940757.286334:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921798272 00000100:00100000:2.0:1788940757.286380:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 409 00000100:00100000:2.0:1788940757.286388:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2404:x1875839921798272:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940757.286478:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2404:x1875839921798272:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 90us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940757.286487:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 409 00000100:00080000:2.0:1788940757.286543:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940757.286548:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788940757.286601:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 413 00000100:00100000:2.0:1788940757.286610:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921799040:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940757.286651:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921799040:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 42us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940757.286659:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 413 00000100:00100000:2.0:1788940757.286676:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 414 00000100:00100000:2.0:1788940757.286683:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+18:2404:x1875839921798400:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940757.286719:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82f3b232-46da-4a78-8599-45df2ddbced0+18:2404:x1875839921798400:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 35us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940757.286725:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 414 00000100:00100000:1.0:1788940757.287474:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921798784 00000100:00100000:1.0:1788940757.287496:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921798784 00000100:00100000:1.0:1788940757.287624:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 161 00000100:00100000:1.0:1788940757.287636:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921798784:12345-192.168.202.25@tcp:400:kworker.0 00000100:00080000:2.0:1788940757.287685:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940757.287758:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921798784:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 123us (1960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940757.287767:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 161 00000100:00100000:3.0:1788940757.288554:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2404:x1875839921798528:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 2474us (2799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940757.288566:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 412 00000100:00100000:3.0:1788940757.301000:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940757.301061:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940757.301314:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921798912 00000100:00100000:2.0:1788940757.301346:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921798912 00000100:00100000:2.0:1788940757.301458:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 415 00000100:00100000:2.0:1788940757.301470:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921798912:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940757.301573:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2404:x1875839921798912:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 104us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940757.301581:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 415 00000100:00080000:3.0:1788940757.302663:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940757.302933:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921798656 00000100:00100000:1.0:1788940757.302945:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921798656 00000100:00100000:1.0:1788940757.303035:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 162 00000100:00100000:1.0:1788940757.303045:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:2404:x1875839921798656:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940757.303139:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82f3b232-46da-4a78-8599-45df2ddbced0+7:2404:x1875839921798656:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 95us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940757.303155:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 162 00000100:00080000:3.0:1788940757.305041:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788940757.342496:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940757.665838:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940757.665868:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944928512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940757.665962:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940757.666056:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944928512 00000100:00100000:2.0:1788940757.666066:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944928512 00000100:00100000:2.0:1788940757.666140:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788940757.666151:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875839944928512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940757.666190:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788940757.666242:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875839944928512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940757.666293:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788940757.666364:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944928512:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788940757.666404:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940757.667981:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944928640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940757.668053:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940757.668108:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944928640 00000100:00100000:3.0:1788940757.668118:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944928640 00000100:00100000:3.0:1788940757.668177:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788940757.668186:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944928640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788940757.668209:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788940757.668277:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944928640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940757.668285:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:3.0:1788940757.669053:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940757.669109:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944928640:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788940758.367565:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940758.684316:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944928768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788940758.684427:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940758.685490:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944928768 00000100:00100000:1.0:1788940758.685503:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944928768 00000100:00100000:1.0:1788940758.685848:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788940758.685863:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944928768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788940758.685924:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788940758.687982:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944928768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2107us (3538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940758.687996:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788940758.688438:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944928768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788940759.241184:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940759.247673:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921799168 00000100:00100000:0.0:1788940759.247852:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921799168 00000100:00100000:2.0:1788940759.248037:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 255 00000100:00100000:2.0:1788940759.248053:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+18:12205:x1875839921799168:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788940759.248188:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82f3b232-46da-4a78-8599-45df2ddbced0+18:12205:x1875839921799168:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 Request processed in 139us (7013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940759.248197:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 255 00000100:00080000:0.0:1788940759.250170:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940759.255848:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940759.260609:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921799296 00000100:00100000:3.0:1788940759.260649:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921799296 00000100:00080000:0.0:1788940759.261397:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788940759.262365:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 256 00000100:00100000:3.0:1788940759.262402:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:12205:x1875839921799296:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788940759.262585:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:12205:x1875839921799296:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 Request processed in 206us (6745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940759.262595:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 256 00000100:00100000:2.0:1788940759.270499:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940759.275950:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921799552 00000100:00100000:3.0:1788940759.275974:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921799552 00000100:00100000:2.0:1788940759.288166:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:2.0:1788940759.288182:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+18:12205:x1875839921799552:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788940759.288967:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+19:12205:x1875839921799552:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 785us (18472us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788940759.288976:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 65 00000001:00080000:3.0:1788940759.295508:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:3.0:1788940759.295537:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788940759.295856:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788940759.295873:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788940759.387946:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940759.709489:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944929024:0@lo:400:kworker.0 00000100:00100000:0.0:1788940759.709551:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940759.709609:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944929536:0@lo:400:kworker.0 00000100:00100000:0.0:1788940759.709630:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940759.709647:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944930048:0@lo:400:kworker.0 00000100:00100000:0.0:1788940759.709663:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940759.709687:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788940759.709693:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944929152:0@lo:400:kworker.0 00000100:00100000:0.0:1788940759.709714:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940759.709727:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944929664:0@lo:400:kworker.0 00000100:00100000:0.0:1788940759.709752:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940759.709764:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944930176:0@lo:400:kworker.0 00000100:00100000:0.0:1788940759.709781:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940759.709804:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944929024 00000100:00100000:0.0:1788940759.709811:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944929024 00000100:00100000:0.0:1788940759.709848:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944929536 00000100:00100000:0.0:1788940759.709852:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944929536 00000100:00100000:0.0:1788940759.709873:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944930048 00000100:00100000:0.0:1788940759.709875:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944930048 00000100:00100000:0.0:1788940759.709887:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944929664 00000100:00100000:0.0:1788940759.709889:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944929664 00000100:00100000:0.0:1788940759.709900:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944930176 00000100:00100000:0.0:1788940759.709902:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944930176 00000100:00100000:0.0:1788940759.709917:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1788940759.709925:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944929024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940759.709976:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944929024:12345-0@lo:400:kworker.0 Request processed in 51us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940759.709995:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1788940759.710013:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1788940759.710018:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944929536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940759.710043:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:0.0:1788940759.710048:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944929536:12345-0@lo:400:kworker.0 Request processed in 30us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940759.710051:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944930048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940759.710054:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1788940759.710065:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1788940759.710070:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944929664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940759.710082:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944930048:12345-0@lo:400:kworker.0 Request processed in 33us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940759.710088:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:0.0:1788940759.710091:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944929664:12345-0@lo:400:kworker.0 Request processed in 21us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940759.710096:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1788940759.710105:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1788940759.710111:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944930176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940759.710137:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944930176:12345-0@lo:400:kworker.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940759.710143:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1788940759.710144:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944929152 00000100:00100000:1.0:1788940759.710148:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944929152 00000100:00100000:1.0:1788940759.710172:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788940759.710179:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944929152:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788940759.710196:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07fd9c00 x1875839944929664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940759.710207:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944929152:12345-0@lo:400:kworker.0 Request processed in 29us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940759.710209:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944929664:0@lo:400:kworker.0 00000100:00100000:1.0:1788940759.710213:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00010000:00080000:0.0:1788940759.710219:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07fd9180 x1875839944930176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940759.710228:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944930176:0@lo:400:kworker.0 00000100:00080000:1.0:1788940759.710229:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940759.710232:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940759.710237:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944929024:0@lo:400:kworker.0 00000100:00100000:0.0:1788940759.710276:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944929536:0@lo:400:kworker.0 00000100:00100000:0.0:1788940759.710288:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944930048:0@lo:400:kworker.0 00000100:00100000:0.0:1788940759.710331:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944929152:0@lo:400:kworker.0 00000100:00100000:3.0:1788940759.711667:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944929280:0@lo:400:kworker.0 00000100:00100000:3.0:1788940759.711723:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940759.711763:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944929792:0@lo:400:kworker.0 00000100:00100000:3.0:1788940759.711787:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940759.711807:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944930304:0@lo:400:kworker.0 00000100:00100000:3.0:1788940759.711826:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940759.711848:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788940759.711854:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944928896:0@lo:400:kworker.0 00000100:00100000:3.0:1788940759.711883:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940759.711907:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944929408:0@lo:400:kworker.0 00000100:00100000:3.0:1788940759.711931:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940759.711951:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944929920:0@lo:400:kworker.0 00000100:00100000:3.0:1788940759.711970:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940759.711986:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944930432:0@lo:400:kworker.0 00000100:00100000:3.0:1788940759.712023:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940759.712057:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944929792 00000100:00100000:3.0:1788940759.712064:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944929792 00000100:00100000:3.0:1788940759.712099:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944930304 00000100:00100000:3.0:1788940759.712102:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944930304 00000100:00100000:3.0:1788940759.712113:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944929920 00000100:00100000:3.0:1788940759.712115:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944929920 00000100:00100000:3.0:1788940759.712125:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944930432 00000100:00100000:3.0:1788940759.712127:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944930432 00000100:00100000:3.0:1788940759.712140:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788940759.712147:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944929792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940759.712173:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944928896 00000100:00100000:1.0:1788940759.712177:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944928896 00000100:00100000:1.0:1788940759.712202:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1788940759.712209:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944928896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940759.712247:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944928896:12345-0@lo:400:kworker.0 Request processed in 38us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940759.712254:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1788940759.712296:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944929408 00000100:00100000:2.0:1788940759.712300:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944929408 00000100:00100000:2.0:1788940759.712330:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788940759.712336:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944929408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940759.712372:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944929408:12345-0@lo:400:kworker.0 Request processed in 36us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940759.712388:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788940759.712429:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944929280 00000100:00100000:2.0:1788940759.712434:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944929280 00000100:00100000:2.0:1788940759.712460:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1788940759.712466:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944929280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940759.712498:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944929280:12345-0@lo:400:kworker.0 Request processed in 32us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940759.712504:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1788940759.712538:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788940759.712548:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944930304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940759.712589:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944930304:12345-0@lo:400:kworker.0 Request processed in 44us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940759.712595:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788940759.712612:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788940759.712618:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1875839944929920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940759.712646:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1875839944929920:12345-0@lo:400:kworker.0 Request processed in 28us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940759.712652:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788940759.712663:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788940759.712669:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944930432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940759.712694:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944930432:12345-0@lo:400:kworker.0 Request processed in 26us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940759.712700:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788940759.712729:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940759.712737:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944930560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940759.712764:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940759.712792:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944930560 00000100:00100000:2.0:1788940759.712802:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944930560 00000100:00100000:2.0:1788940759.712828:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788940759.712835:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944930560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940759.712858:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940759.712892:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944930560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940759.712898:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:2.0:1788940759.712916:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940759.712920:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940759.712946:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944930560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940759.712977:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944928896:0@lo:400:kworker.0 00000100:00100000:2.0:1788940759.712986:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944929408:0@lo:400:kworker.0 00000100:00100000:2.0:1788940759.712995:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944929920:0@lo:400:kworker.0 00000100:00100000:2.0:1788940759.713002:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944930432:0@lo:400:kworker.0 00000100:00100000:2.0:1788940759.713010:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944929280:0@lo:400:kworker.0 00000100:00100000:2.0:1788940759.713020:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944930304:0@lo:400:kworker.0 00000100:00100000:3.0:1788940759.714322:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944929792:12345-0@lo:400:kworker.0 Request processed in 2169us (2527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940759.714334:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000001:00080000:1.0:1788940759.714518:0:8432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000100:00100000:2.0:1788940759.715579:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944929792:0@lo:400:kworker.0 00000100:00100000:0.0:1788940759.715805:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940759.715818:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944930688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940759.715869:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940759.721423:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944930688 00000100:00100000:3.0:1788940759.721438:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944930688 00000100:00100000:3.0:1788940759.721511:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788940759.721522:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944930688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788940759.721551:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940759.721642:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944930688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (5773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940759.721649:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788940759.722685:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944930688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940759.793696:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940759.793837:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921799680 00000100:00100000:2.0:1788940759.793852:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921799680 00000100:00100000:2.0:1788940759.793959:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 257 00000100:00100000:2.0:1788940759.793972:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:13010:x1875839921799680:12345-192.168.202.25@tcp:101:lsof.0 00010000:00010000:2.0:1788940759.794001:0:8517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940759.794029:0:8517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08bade1fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc75fc expref: -99 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940759.794146:0:8517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade203 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940759.794164:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940759.794182:0:8517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940759.794250:0:8517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788940759.794399:0:8517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788940759.794436:0:8517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940759.794468:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6c00/0x9c34acc08bade1fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75fc expref: 7 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940759.794491:0:8517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade203 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75fc expref: 6 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940759.794501:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65400) 00010000:00010000:2.0:1788940759.794504:0:8517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940759.794509:0:8517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7600, rc 0) 00000100:00100000:2.0:1788940759.794608:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:13010:x1875839921799680:12345-192.168.202.25@tcp:101:lsof.0 Request processed in 639us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940759.794615:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 257 00000100:00080000:1.0:1788940759.794708:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788940760.413953:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940761.435667:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940762.267736:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944930816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940762.267853:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940762.268112:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944930816 00000100:00100000:2.0:1788940762.268126:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944930816 00000100:00100000:2.0:1788940762.268217:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788940762.268229:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944930816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940762.268303:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788940762.268373:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944930816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940762.268382:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788940762.268699:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944930816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940762.406472:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940762.406564:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940762.406606:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940762.406630:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940762.406649:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940762.406671:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940762.406776:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921800064 00000100:00100000:1.0:1788940762.406809:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921800064 00000100:00100000:0.0:1788940762.406881:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940762.406897:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921800576 00000100:00100000:1.0:1788940762.406901:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921800576 00000100:00100000:0.0:1788940762.406903:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921799936 00000100:00100000:0.0:1788940762.406905:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921799936 00000100:00100000:1.0:1788940762.406918:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921800448 00000100:00100000:1.0:1788940762.406920:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921800448 00000100:00100000:0.0:1788940762.406933:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 422 00000100:00100000:0.0:1788940762.406943:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921800064:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940762.406995:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921799808 00000100:00100000:2.0:1788940762.406999:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921799808 00000100:00100000:2.0:1788940762.407033:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 411 00000100:00100000:0.0:1788940762.407036:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921800064:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 96us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940762.407040:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2406:x1875839921799808:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940762.407485:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2406:x1875839921799808:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 444us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940762.407493:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 411 00000100:00100000:2.0:1788940762.407557:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921800320 00000100:00100000:2.0:1788940762.407562:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921800320 00000100:00100000:2.0:1788940762.407593:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921800192 00000100:00100000:2.0:1788940762.407596:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921800192 00000100:00100000:2.0:1788940762.407619:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 167 00000100:00100000:2.0:1788940762.407627:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921800320:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940762.407655:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2406:x1875839921800320:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 30us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940762.407662:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 167 00000100:00100000:2.0:1788940762.414079:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 168 00000100:00100000:2.0:1788940762.414108:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+7:2406:x1875839921800192:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940762.414225:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+7:2406:x1875839921800192:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 131us (7553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940762.414272:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 168 00000100:00100000:1.0:1788940762.418847:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 423 00000100:00100000:1.0:1788940762.420039:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2406:x1875839921800576:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940762.420154:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2406:x1875839921800576:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 1291us (13522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940762.420166:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 423 00000100:00100000:1.0:1788940762.420198:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 424 00000100:00100000:1.0:1788940762.420701:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+18:2406:x1875839921799936:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940762.420744:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+18:2406:x1875839921799936:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 538us (14093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940762.420752:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 424 00000100:00100000:1.0:1788940762.420770:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 425 00000100:00100000:1.0:1788940762.420778:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2406:x1875839921800448:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940762.420805:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2406:x1875839921800448:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 28us (14104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940762.420811:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 425 00000100:00080000:1.0:1788940762.420847:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940762.420854:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940762.420859:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940762.420862:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788940762.427310:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 422 00010000:00010000:3.0:1788940762.462334:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940762.779710:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944930944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940762.779831:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940762.779878:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944930944 00000100:00100000:2.0:1788940762.779900:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944930944 00000100:00100000:2.0:1788940762.779977:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788940762.779989:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944930944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788940762.780028:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:1.0:1788940762.780096:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940762.780100:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944930944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940762.780108:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788940762.780238:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944930944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940762.780799:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944931072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940762.780834:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940762.780928:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944931072 00000100:00100000:3.0:1788940762.780944:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944931072 00000100:00100000:3.0:1788940762.780992:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788940762.781000:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944931072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940762.781015:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788940762.781066:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944931072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940762.781073:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788940762.781100:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1788940762.781106:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91cf0610ad80, transno 4294967325 00000100:00100000:3.0:1788940762.781120:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944931072:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788940762.781633:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788940763.483582:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940763.804410:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940763.804455:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944931200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788940763.804573:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940763.804825:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944931200 00000100:00100000:0.0:1788940763.804847:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944931200 00000100:00100000:0.0:1788940763.804924:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788940763.804936:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944931200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788940763.804996:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788940763.805072:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944931200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940763.805080:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788940763.805366:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944931200:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788940764.443564:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940764.443579:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940764.443725:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788940764.443733:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788940764.513207:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788940764.831851:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788940764.832197:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940764.832221:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944931328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940764.832335:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940764.833806:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944931328 00000100:00100000:2.0:1788940764.833821:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944931328 00000100:00100000:2.0:1788940764.833906:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788940764.833919:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944931328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940764.833971:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940764.834054:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944931328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940764.834062:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788940764.834135:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944931328:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788940764.834641:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940764.836854:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944931840:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.836941:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940764.836993:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944932352:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.837024:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940764.837042:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944932864:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.837064:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940764.837100:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788940764.837106:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944931456:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.837137:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940764.837174:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944931968:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.837200:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940764.837218:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944932480:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.837238:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940764.837291:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944931584:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.837318:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940764.837338:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944932096:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.837359:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940764.837372:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944932608:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.837388:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940764.837404:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788940764.837410:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944931712:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.837427:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940764.837443:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944932224:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.837460:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940764.837472:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944932736:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.837489:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940764.837527:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944931840 00000100:00100000:3.0:1788940764.837537:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944931840 00000100:00100000:3.0:1788940764.837581:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944931584 00000100:00100000:3.0:1788940764.837584:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944931584 00000100:00100000:3.0:1788940764.837594:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944932096 00000100:00100000:3.0:1788940764.837596:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944932096 00000100:00100000:3.0:1788940764.837619:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944932608 00000100:00100000:3.0:1788940764.837621:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944932608 00000100:00100000:3.0:1788940764.837633:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944932224 00000100:00100000:3.0:1788940764.837635:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944932224 00000100:00100000:3.0:1788940764.837655:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944932736 00000100:00100000:3.0:1788940764.837658:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944932736 00000100:00100000:3.0:1788940764.837678:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1788940764.837688:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944931840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.837752:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944931840:12345-0@lo:400:kworker.0 Request processed in 66us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940764.837760:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1788940764.837780:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1788940764.837786:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944931584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.837817:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944931584:12345-0@lo:400:kworker.0 Request processed in 31us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940764.837823:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1788940764.837835:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1788940764.837840:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944932096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.837866:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944932096:12345-0@lo:400:kworker.0 Request processed in 26us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940764.837871:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1788940764.837883:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1788940764.837889:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944932608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.837914:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944932608:12345-0@lo:400:kworker.0 Request processed in 25us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940764.837922:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1788940764.837934:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1788940764.837939:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944932224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.837963:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944932224:12345-0@lo:400:kworker.0 Request processed in 24us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940764.837976:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1788940764.837990:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1788940764.837996:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944932736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.838025:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944932736:12345-0@lo:400:kworker.0 Request processed in 29us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940764.838030:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1788940764.838051:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944932352 00000100:00100000:3.0:1788940764.838054:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944932352 00000100:00100000:3.0:1788940764.838083:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944932864 00000100:00100000:3.0:1788940764.838086:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944932864 00000100:00100000:3.0:1788940764.838100:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944932480 00000100:00100000:3.0:1788940764.838102:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944932480 00000100:00100000:3.0:1788940764.838114:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788940764.838119:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944932352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.838151:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944932352:12345-0@lo:400:kworker.0 Request processed in 32us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940764.838157:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788940764.838168:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788940764.838173:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944932864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.838200:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944932864:12345-0@lo:400:kworker.0 Request processed in 27us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940764.838207:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788940764.838217:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788940764.838223:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944932480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.838251:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944932480:12345-0@lo:400:kworker.0 Request processed in 29us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940764.838291:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788940764.838317:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944931456 00000100:00100000:3.0:1788940764.838320:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944931456 00000100:00100000:3.0:1788940764.838343:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1788940764.838350:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944931456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.838380:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944931456:12345-0@lo:400:kworker.0 Request processed in 31us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940764.838387:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1788940764.838417:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944931968 00000100:00100000:3.0:1788940764.838421:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944931968 00000100:00100000:3.0:1788940764.838446:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944931712 00000100:00100000:3.0:1788940764.838449:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944931712 00000100:00100000:3.0:1788940764.838462:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788940764.838468:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944931968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.838506:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944931968:12345-0@lo:400:kworker.0 Request processed in 37us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940764.838511:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788940764.838533:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788940764.838539:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944931712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.838566:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944931712:12345-0@lo:400:kworker.0 Request processed in 28us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940764.838571:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:3.0:1788940764.838615:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940764.838621:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940764.838623:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788940764.838626:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940764.838665:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944931712:0@lo:400:kworker.0 00010000:00080000:3.0:1788940764.838691:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07845500 x1875839944932224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940764.838703:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944932224:0@lo:400:kworker.0 00010000:00080000:3.0:1788940764.838716:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07844000 x1875839944932736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940764.838725:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944932736:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.838736:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944931584:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.838747:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944932096:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.838756:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944932608:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.838796:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944931456:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.838807:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944931968:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.838816:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944932480:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.838827:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944931840:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.838837:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944932352:0@lo:400:kworker.0 00000100:00100000:3.0:1788940764.838847:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944932864:0@lo:400:kworker.0 00000100:00100000:2.0:1788940764.839861:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940764.839879:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944932992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940764.839937:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940764.840131:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944932992 00000100:00100000:0.0:1788940764.840140:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944932992 00000100:00100000:0.0:1788940764.840182:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788940764.840190:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944932992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788940764.840213:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940764.840280:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944932992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940764.840287:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788940764.840452:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944932992:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788940765.532032:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788940765.570793:0:14965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 03:59:23 (1788940763) 00010000:00010000:0.0:1788940766.569580:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940767.388790:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944933120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940767.388901:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940767.389000:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944933120 00000100:00100000:2.0:1788940767.389014:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944933120 00000100:00100000:2.0:1788940767.389097:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788940767.389107:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944933120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940767.389146:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788940767.389253:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944933120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940767.389302:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788940767.389409:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944933120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788940767.529951:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940767.530017:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940767.530047:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940767.530092:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940767.530133:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921800960 00000100:00100000:2.0:1788940767.530146:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921800960 00000100:00100000:2.0:1788940767.530220:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921800832 00000100:00100000:2.0:1788940767.530224:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921800832 00000100:00100000:2.0:1788940767.530251:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 432 00000100:00100000:2.0:1788940767.530285:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921800960:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940767.530386:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2405:x1875839921800960:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 105us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940767.530395:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 432 00000100:00100000:2.0:1788940767.530416:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 433 00000100:00100000:2.0:1788940767.530423:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+18:2405:x1875839921800832:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940767.530448:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+18:2405:x1875839921800832:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 26us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940767.530455:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 433 00000100:00100000:2.0:1788940767.530480:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921801088 00000100:00100000:2.0:1788940767.530484:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921801088 00000100:00100000:2.0:1788940767.530550:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 172 00000100:00100000:2.0:1788940767.530557:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921801088:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940767.530584:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+7:2405:x1875839921801088:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 29us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940767.530591:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 172 00000100:00080000:2.0:1788940767.530612:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940767.530618:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940767.530620:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788940767.530794:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921800704 00000100:00100000:0.0:1788940767.530800:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921800704 00000100:00100000:0.0:1788940767.530847:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 413 00000100:00100000:0.0:1788940767.530855:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2405:x1875839921800704:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940767.530884:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2405:x1875839921800704:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 31us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940767.530891:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 413 00000100:00100000:1.0:1788940767.541214:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940767.541325:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921801216 00000100:00100000:0.0:1788940767.541338:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921801216 00000100:00100000:0.0:1788940767.542290:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 80 00000100:00100000:0.0:1788940767.542307:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+5:2403:x1875839921801216:12345-192.168.202.25@tcp:9:kworker.0 00000020:00000080:0.0:1788940767.542352:0:8439:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd4f8 00000100:00080000:0.0:1788940767.542365:0:8439:0:(import.c:65:import_set_state_nolock()) ffff91d00c269000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788940767.542432:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:2.0:1788940767.542632:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940767.543784:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940767.544025:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940767.544307:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921801344 00000100:00100000:2.0:1788940767.544319:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921801344 00000100:00100000:2.0:1788940767.544388:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921801472 00000100:00100000:2.0:1788940767.544392:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921801472 00000100:00100000:2.0:1788940767.544419:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 434 00000100:00100000:2.0:1788940767.544429:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2405:x1875839921801344:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940767.545158:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2405:x1875839921801344:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 727us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940767.545170:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 434 00000100:00100000:2.0:1788940767.545192:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 435 00000100:00100000:2.0:1788940767.545199:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921801472:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940767.545250:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82f3b232-46da-4a78-8599-45df2ddbced0+2:2403:x1875839921801216:12345-192.168.202.25@tcp:9:kworker.0 Request processed in 2948us (4051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940767.545334:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 80 00010000:00010000:0.0:1788940767.545362:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940767.551353:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2405:x1875839921801472:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 6138us (7310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940767.551371:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 435 00000100:00080000:2.0:1788940767.551439:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940767.551453:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788940767.580628:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940767.899801:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944933248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940767.899884:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940767.900873:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944933376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940767.900926:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940767.900988:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944933248 00000100:00100000:3.0:1788940767.900999:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944933248 00000100:00100000:3.0:1788940767.901071:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944933376 00000100:00100000:3.0:1788940767.901074:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944933376 00000100:00100000:3.0:1788940767.901092:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788940767.901102:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944933248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788940767.901145:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:2.0:1788940767.901378:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940767.901848:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944933248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 744us (1960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940767.901859:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788940767.901885:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788940767.901894:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944933376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940767.901909:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788940767.901952:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944933376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940767.901958:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788940767.902048:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944933376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940767.902194:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944933248:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788940768.603578:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940768.730733:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940768.730821:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921801728 00000100:00100000:2.0:1788940768.730832:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921801728 00000100:00100000:2.0:1788940768.730901:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:2.0:1788940768.730912:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+18:13234:x1875839921801728:12345-192.168.202.25@tcp:35:umount.0 00000100:00100000:2.0:1788940768.731179:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+19:13234:x1875839921801728:12345-192.168.202.25@tcp:35:umount.0 Request processed in 267us (456us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788940768.731187:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:1.0:1788940768.747065:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940768.747294:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921801984 00000100:00100000:2.0:1788940768.747304:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921801984 00000100:00100000:2.0:1788940768.747355:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:2.0:1788940768.747363:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+19:13234:x1875839921801984:12345-192.168.202.25@tcp:35:umount.0 00000100:00100000:2.0:1788940768.749468:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+20:13234:x1875839921801984:12345-192.168.202.25@tcp:35:umount.0 Request processed in 2096us (2405us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788940768.749490:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:0.0:1788940768.762602:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940768.762848:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921802240 00000100:00100000:3.0:1788940768.762860:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921802240 00000100:00100000:3.0:1788940768.763501:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 68 00000100:00100000:3.0:1788940768.763512:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d002e60450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+20:13234:x1875839921802240:12345-192.168.202.25@tcp:35:umount.0 00000100:00100000:3.0:1788940768.763758:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d002e60450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82f3b232-46da-4a78-8599-45df2ddbced0+21:13234:x1875839921802240:12345-192.168.202.25@tcp:35:umount.0 Request processed in 246us (1165us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788940768.763766:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 68 00000100:00100000:1.0:1788940768.775768:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940768.776470:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921802496 00000100:00100000:2.0:1788940768.776493:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921802496 00000100:00100000:2.0:1788940768.776614:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 69 00000100:00100000:2.0:1788940768.776625:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+21:13234:x1875839921802496:12345-192.168.202.25@tcp:35:umount.0 00000100:00100000:2.0:1788940768.776946:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82f3b232-46da-4a78-8599-45df2ddbced0+22:13234:x1875839921802496:12345-192.168.202.25@tcp:35:umount.0 Request processed in 322us (1186us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1788940768.776954:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 69 00000100:00100000:1.0:1788940768.791441:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940768.791500:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940768.791599:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921802880 00000100:00100000:0.0:1788940768.791611:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921802880 00000100:00100000:0.0:1788940768.791680:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921802752 00000100:00100000:0.0:1788940768.791684:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921802752 00000100:00100000:0.0:1788940768.791717:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:0.0:1788940768.791728:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9d4689c-491f-4d5c-b012-ebe6beb5c037+14:2406:x1875839921802880:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940768.791760:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940768.791784:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d035937600/0x9c34acc08badd411 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7228 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940768.791804:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940768.791868:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9d4689c-491f-4d5c-b012-ebe6beb5c037+13:2406:x1875839921802880:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 141us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940768.791877:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:0.0:1788940768.791895:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:0.0:1788940768.791913:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9d4689c-491f-4d5c-b012-ebe6beb5c037+12:2406:x1875839921802752:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940768.791921:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940768.791930:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaaba00/0x9c34acc08badd11d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7110 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940768.791940:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940768.791958:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:2406:x1875839921802752:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 45us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940768.791964:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:0.0:1788940768.800535:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940768.801857:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921802624 00000100:00100000:1.0:1788940768.801885:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921802624 00000100:00100000:1.0:1788940768.801976:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:1.0:1788940768.801986:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:2405:x1875839921802624:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940768.802002:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940768.802022:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0027f7400/0x9c34acc08badd1da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc714f expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940768.802039:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940768.802106:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2405:x1875839921802624:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 121us (1581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940768.802114:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:1.0:1788940768.822191:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940768.826813:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921803264 00000100:00100000:2.0:1788940768.826849:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921803264 00000100:00100000:2.0:1788940768.826940:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 81 00000100:00100000:2.0:1788940768.826952:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+7:2403:x1875839921803264:12345-192.168.202.25@tcp:9:umount.0 00000020:00000080:2.0:1788940768.826994:0:8524:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd76e 00000020:00010000:2.0:1788940768.827003:0:8524:0:(genops.c:1929:obd_stale_export_put()) Put export ffff91cf01ac3800: total 0 00000100:00080000:2.0:1788940768.827008:0:8524:0:(import.c:65:import_set_state_nolock()) ffff91cf01ac4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788940768.827075:0:8524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788940768.827404:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82f3b232-46da-4a78-8599-45df2ddbced0+5:2403:x1875839921803264:12345-192.168.202.25@tcp:9:umount.0 Request processed in 452us (5221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940768.827413:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 81 00000020:00010000:0.0:1788940768.829081:0:6509:0:(genops.c:1915:obd_stale_export_get()) Get export ffff91cf01ac3800: total 0 00010000:00010000:0.0:1788940768.829152:0:6509:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91cf01ac3800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788940768.829244:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc990318/0x9c34acc08bade1f5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75f5 expref: 4 pid: 8524 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940768.829332:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e206da54/0x9c34acc08baddb26 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7412 expref: 3 pid: 8524 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940768.829372:0:6509:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91cf01ac3800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788940768.829389:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940768.829391:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940768.829392:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940768.861382:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940768.861796:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921804288 00000100:00100000:2.0:1788940768.861808:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921804288 00000100:00100000:2.0:1788940768.861885:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 258 00000100:00100000:2.0:1788940768.861897:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+22:2403:x1875839921804288:12345-192.168.202.25@tcp:39:umount.0 00000020:00000080:2.0:1788940768.861934:0:6522:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd12b 00000020:00010000:2.0:1788940768.861949:0:6522:0:(genops.c:1929:obd_stale_export_put()) Put export ffff91cf01ac2800: total 0 00000100:00080000:2.0:1788940768.861954:0:6522:0:(import.c:65:import_set_state_nolock()) ffff91cf01ac7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788940768.861987:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1788940768.862551:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82f3b232-46da-4a78-8599-45df2ddbced0+21:2403:x1875839921804288:12345-192.168.202.25@tcp:39:umount.0 Request processed in 653us (1176us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1788940768.862561:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 258 00000020:00010000:3.0:1788940768.865660:0:6508:0:(genops.c:1915:obd_stale_export_get()) Get export ffff91cf01ac2800: total 0 00010000:00010000:3.0:1788940768.865774:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91cf01ac2800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788940768.865822:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:3.0:1788940768.865827:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788940768.865840:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7a00/0x9c34acc08baddbab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7435 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940768.865865:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91d0421d1c00) 00010000:00010000:3.0:1788940768.865867:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940768.865872:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d600/0x9c34acc08badd457 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7236 expref: 19 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940768.865892:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:3.0:1788940768.865894:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940768.865898:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6000/0x9c34acc08bade1b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75e0 expref: 18 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940768.865908:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:3.0:1788940768.865910:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940768.865914:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7400/0x9c34acc08badda07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73c5 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940768.865926:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:3.0:1788940768.865929:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788940768.865932:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936000/0x9c34acc08badde98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc750e expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940768.865947:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65400) 00010000:00010000:3.0:1788940768.865950:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940768.865961:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936400/0x9c34acc08baddb8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc742e expref: 15 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940768.865974:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:3.0:1788940768.865977:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788940768.865981:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d200/0x9c34acc08bade1e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75ee expref: 14 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940768.865994:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:3.0:1788940768.865996:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788940768.865999:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937e00/0x9c34acc08badd4ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7252 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940768.866010:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:3.0:1788940768.866012:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940768.866015:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08baddae7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc73fd expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940768.866027:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91cf07e65100) 00010000:00010000:3.0:1788940768.866030:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940768.866033:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d000031e00/0x9c34acc08bade0d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75a8 expref: 11 pid: 9713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940768.866064:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91d00c3af100) 00010000:00010000:3.0:1788940768.866067:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788940768.866070:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08baddb11 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc740b expref: 10 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940768.866085:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91cf07e65600) 00010000:00010000:3.0:1788940768.866093:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788940768.866099:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937400/0x9c34acc08badd7c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc732b expref: 9 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940768.866116:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91cf07e67400) 00010000:00010000:3.0:1788940768.866118:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940768.866122:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e6e00/0x9c34acc08badd473 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc723d expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940768.866134:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91cf01ac2800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788940768.866149:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940768.866151:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940768.866153:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940768.897685:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940768.897795:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921804416 00000100:00100000:2.0:1788940768.897810:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921804416 00000100:00100000:2.0:1788940768.897895:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 259 00000100:00100000:2.0:1788940768.897907:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+5:2403:x1875839921804416:12345-192.168.202.25@tcp:39:umount.0 00000020:00000080:2.0:1788940768.897950:0:6520:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd132 00000100:00080000:2.0:1788940768.897974:0:6520:0:(import.c:65:import_set_state_nolock()) ffff91cf08456800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788940768.898032:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788940768.898996:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82f3b232-46da-4a78-8599-45df2ddbced0+3:2403:x1875839921804416:12345-192.168.202.25@tcp:39:umount.0 Request processed in 1088us (1317us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788940768.899007:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 259 00010000:00010000:1.0:1788940768.899132:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940768.924500:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940768.924526:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944933504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788940768.924597:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940768.924723:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944933504 00000100:00100000:0.0:1788940768.924735:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944933504 00000100:00100000:0.0:1788940768.924794:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788940768.924805:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944933504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788940768.924841:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788940768.924904:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944933504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940768.924911:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788940768.925447:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944933504:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788940769.629376:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940769.948002:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d037874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944933632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788940769.948083:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940769.948200:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944933632 00000100:00100000:0.0:1788940769.948209:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944933632 00000100:00100000:0.0:1788940769.948290:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788940769.948300:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944933632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788940769.948336:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788940769.948396:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944933632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940769.948406:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788940769.948583:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944934016:0@lo:400:kworker.0 00000100:00100000:0.0:1788940769.948663:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944933888:0@lo:400:kworker.0 00000100:00100000:3.0:1788940769.948669:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940769.948732:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944934528:0@lo:400:kworker.0 00000100:00100000:0.0:1788940769.948733:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940769.948777:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944934400:0@lo:400:kworker.0 00000100:00100000:3.0:1788940769.948783:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940769.948818:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839944935040:0@lo:400:kworker.0 00000100:00100000:0.0:1788940769.948844:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940769.948858:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940769.948880:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944934912:0@lo:400:kworker.0 00000100:00100000:0.0:1788940769.948915:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940769.948917:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944934016 00000100:00100000:3.0:1788940769.948927:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944934016 00000100:00100000:0.0:1788940769.948980:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944934400 00000100:00100000:3.0:1788940769.948986:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944934528 00000100:00100000:0.0:1788940769.948988:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944934400 00000100:00100000:0.0:1788940769.949031:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788940769.949038:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944934400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940769.949080:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944934400:12345-0@lo:400:kworker.0 Request processed in 42us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940769.949087:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788940769.949129:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944934400:0@lo:400:kworker.0 00000100:00100000:0.0:1788940769.949180:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944935040 00000100:00100000:0.0:1788940769.949184:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944935040 00000100:00100000:0.0:1788940769.949213:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1788940769.949221:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944934016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940769.949285:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944934016:12345-0@lo:400:kworker.0 Request processed in 65us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940769.949292:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1788940769.949307:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1788940769.949313:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839944935040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940769.949343:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839944935040:12345-0@lo:400:kworker.0 Request processed in 30us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940769.949349:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1788940769.949451:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944933888 00000100:00100000:2.0:1788940769.949456:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944933888 00000100:00100000:2.0:1788940769.949508:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1788940769.949515:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944933888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940769.949558:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944933888:12345-0@lo:400:kworker.0 Request processed in 44us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940769.949565:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00080000:2.0:1788940769.949595:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940769.949599:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940769.949635:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944934528 00000100:00100000:2.0:1788940769.949638:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944933888:0@lo:400:kworker.0 00000100:00080000:2.0:1788940769.949682:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940769.949698:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:3.0:1788940769.949709:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944934528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940769.949737:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839944935040:0@lo:400:kworker.0 00000100:00100000:2.0:1788940769.949755:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944934016:0@lo:400:kworker.0 00000100:00100000:3.0:1788940769.949783:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944934528:12345-0@lo:400:kworker.0 Request processed in 72us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940769.949793:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1788940769.949799:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944934528:0@lo:400:kworker.0 00000100:00100000:1.0:1788940769.951152:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944934912 00000100:00100000:1.0:1788940769.951163:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944934912 00000100:00100000:1.0:1788940769.951233:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788940769.951243:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944934912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940769.951349:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944934912:12345-0@lo:400:kworker.0 Request processed in 109us (2433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940769.951356:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788940769.951385:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944934144:0@lo:400:kworker.0 00000100:00100000:1.0:1788940769.951417:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940769.951441:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944934656:0@lo:400:kworker.0 00000100:00100000:1.0:1788940769.951463:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940769.951506:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944935168:0@lo:400:kworker.0 00000100:00100000:3.0:1788940769.951557:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944934912:0@lo:400:kworker.0 00000100:00100000:0.0:1788940769.951590:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944934144 00000100:00100000:0.0:1788940769.951597:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944934144 00000100:00100000:0.0:1788940769.951637:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788940769.951645:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944933760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940769.951666:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944934144:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788940769.951728:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940769.951765:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944934656 00000100:00100000:2.0:1788940769.951770:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944934656 00000100:00100000:2.0:1788940769.951804:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1788940769.951811:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944934656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940769.961047:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940769.961165:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d037874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944933632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788940769.961225:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944935168 00000100:00100000:1.0:1788940769.961232:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944935168 00000100:00100000:1.0:1788940769.961597:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:1.0:1788940769.961608:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944935168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940769.961667:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944935168:12345-0@lo:400:kworker.0 Request processed in 61us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940769.961674:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00010000:00080000:1.0:1788940769.961709:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08c0d500 x1875839944935168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940769.961741:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944935168:0@lo:400:kworker.0 00000100:00080000:1.0:1788940769.961802:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788940769.967428:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940769.967519:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944934272:0@lo:400:kworker.0 00000100:00100000:3.0:1788940769.967566:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940769.967608:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944934784:0@lo:400:kworker.0 00000100:00100000:3.0:1788940769.967637:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940769.967683:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944934784 00000100:00100000:3.0:1788940769.967692:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944934784 00000100:00100000:3.0:1788940769.967775:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788940769.967786:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944934784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940769.967856:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944934784:12345-0@lo:400:kworker.0 Request processed in 71us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940769.967864:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788940769.967918:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944934784:0@lo:400:kworker.0 00000100:00100000:3.0:1788940769.967927:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944935296:0@lo:400:kworker.0 00000100:00100000:3.0:1788940769.967953:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940769.967990:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944935296 00000100:00100000:3.0:1788940769.968246:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944935296 00000100:00100000:3.0:1788940769.968311:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788940769.968318:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944935296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940769.968356:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944935296:12345-0@lo:400:kworker.0 Request processed in 39us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940769.968362:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788940769.968395:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944935296:0@lo:400:kworker.0 00000100:00100000:1.0:1788940769.969156:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944933760 00000100:00100000:1.0:1788940769.969170:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944933760 00000100:00100000:1.0:1788940769.969393:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788940769.969407:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944933760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940769.969434:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788940769.969461:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944934272 00000100:00100000:3.0:1788940769.969479:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944934272 00000100:00100000:1.0:1788940769.969538:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944933760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (2122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940769.969539:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1788940769.969555:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788940769.969558:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944934272:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788940769.969592:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940769.969598:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940769.969633:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944934272:12345-0@lo:400:kworker.0 Request processed in 78us (2064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940769.969641:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1788940769.969697:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944933760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940769.969714:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944934272:0@lo:400:kworker.0 00000100:00100000:2.0:1788940769.970186:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944934656:12345-0@lo:400:kworker.0 Request processed in 18372us (18718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940769.970196:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00010000:00080000:1.0:1788940769.970453:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07fdb100 x1875839944934656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940769.970478:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944934656:0@lo:400:kworker.0 00000100:00100000:0.0:1788940769.971569:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944934144:12345-0@lo:400:kworker.0 Request processed in 19903us (20145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940769.971581:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788940769.971699:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944934144:0@lo:400:kworker.0 00010000:00010000:3.0:1788940770.658700:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940771.675857:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940771.767447:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940771.767536:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940771.767653:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921804672 00000100:00100000:3.0:1788940771.767665:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921804672 00000100:00100000:3.0:1788940771.767747:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921804800 00000100:00100000:3.0:1788940771.767750:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921804800 00000100:00100000:3.0:1788940771.767798:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:3.0:1788940771.767809:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+11:2407:x1875839921804672:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940771.767828:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940771.767863:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584c400/0x9c34acc08badd235 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7195 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940771.767887:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940771.767950:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2407:x1875839921804672:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 142us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940771.767957:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:2.0:1788940771.767968:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d003fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+10:2407:x1875839921804800:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940771.767977:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940771.767988:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0355e7200/0x9c34acc08badd3ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7221 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.767997:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940771.768030:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d003fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9d4689c-491f-4d5c-b012-ebe6beb5c037+9:2407:x1875839921804800:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 64us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940771.771916:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:0.0:1788940771.772971:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940771.774186:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921804544 00000100:00100000:3.0:1788940771.774207:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921804544 00000100:00100000:3.0:1788940771.774366:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:3.0:1788940771.774382:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9d4689c-491f-4d5c-b012-ebe6beb5c037+9:2404:x1875839921804544:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940771.774403:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940771.774429:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584d400/0x9c34acc08badd22e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7164 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940771.774460:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940771.774545:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9d4689c-491f-4d5c-b012-ebe6beb5c037+8:2404:x1875839921804544:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 168us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940771.774554:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:2.0:1788940771.774667:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:3.0:1788940771.778542:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940771.780537:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921805056 00000100:00100000:1.0:1788940771.780561:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921805056 00000100:00100000:1.0:1788940771.780680:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 260 00000100:00100000:1.0:1788940771.780695:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+6:2403:x1875839921805056:12345-192.168.202.25@tcp:39:umount.0 00000020:00000080:1.0:1788940771.780753:0:6521:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd243 00000020:00010000:1.0:1788940771.780764:0:6521:0:(genops.c:1929:obd_stale_export_put()) Put export ffff91d020c94000: total 0 00000100:00080000:1.0:1788940771.780804:0:6521:0:(import.c:65:import_set_state_nolock()) ffff91d020c96000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788940771.780850:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:1.0:1788940771.781051:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2403:x1875839921805056:12345-192.168.202.25@tcp:39:umount.0 Request processed in 359us (2522us total) trans 4294967529 rc 0/0 00000100:00100000:1.0:1788940771.781059:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 260 00000100:00080000:2.0:1788940771.781753:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1788940771.782367:0:6509:0:(genops.c:1915:obd_stale_export_get()) Get export ffff91d020c94000: total 0 00010000:00010000:0.0:1788940771.784041:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940771.784146:0:6509:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91d020c94000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788940771.784192:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf07e65400) 00010000:00010000:0.0:1788940771.784196:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940771.784208:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0355e7600/0x9c34acc08bade203 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc75fc expref: 4 pid: 8517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.784236:0:6509:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91d020c94000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788940771.784251:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940771.784253:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940771.784270:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940771.790679:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940771.790765:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921805184 00000100:00100000:1.0:1788940771.790793:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921805184 00000100:00080000:2.0:1788940771.791018:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788940771.791105:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 261 00000100:00100000:1.0:1788940771.791117:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+5:2403:x1875839921805184:12345-192.168.202.25@tcp:39:umount.0 00000020:00000080:1.0:1788940771.791174:0:6520:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd24a 00000100:00080000:1.0:1788940771.791189:0:6520:0:(import.c:65:import_set_state_nolock()) ffff91d020c91800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788940771.791229:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788940771.791463:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fe11818-a425-4818-b40c-4d2e4f9916d8+3:2403:x1875839921805184:12345-192.168.202.25@tcp:39:umount.0 Request processed in 348us (794us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788940771.791473:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 261 00010000:00010000:0.0:1788940771.792103:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940771.820494:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940771.820773:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921805440 00000100:00100000:2.0:1788940771.820789:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921805440 00000100:00100000:2.0:1788940771.820874:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 415 00000100:00100000:2.0:1788940771.820887:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d039908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+7:2403:x1875839921805440:12345-192.168.202.25@tcp:251:umount.0 00000020:00000080:2.0:1788940771.820964:0:6513:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd108 00000020:00010000:2.0:1788940771.820980:0:6513:0:(genops.c:1929:obd_stale_export_put()) Put export ffff91cf07a1b800: total 0 00000100:00080000:2.0:1788940771.820985:0:6513:0:(import.c:65:import_set_state_nolock()) ffff91cf07a18800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788940771.821082:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d039908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9d4689c-491f-4d5c-b012-ebe6beb5c037+3:2403:x1875839921805440:12345-192.168.202.25@tcp:251:umount.0 Request processed in 198us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940771.821090:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 415 00000020:00010000:1.0:1788940771.822503:0:10401:0:(genops.c:1915:obd_stale_export_get()) Get export ffff91cf07a1b800: total 0 00010000:00010000:1.0:1788940771.822603:0:10401:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91cf07a1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788940771.822648:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0027f6000/0x9c34acc08badd1e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7156 expref: 2 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.822669:0:10401:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91cf07a1b800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788940771.822681:0:10401:0:(genops.c:893:class_export_put()) final put ffff91cf07a1b800/b9d4689c-491f-4d5c-b012-ebe6beb5c037 00010000:00010000:1.0:1788940771.822704:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940771.822706:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940771.822708:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788940771.822748:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf07a1b800/b9d4689c-491f-4d5c-b012-ebe6beb5c037 for MGS 00000020:00000080:2.0:1788940771.822813:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf07a18800 for MGS 00000100:00100000:3.0:1788940772.511417:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944935424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940772.511561:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940772.512816:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944935424 00000100:00100000:1.0:1788940772.512834:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944935424 00000100:00100000:1.0:1788940772.512910:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788940772.513138:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944935424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788940772.513288:0:7798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788940772.516376:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944935424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3236us (4807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940772.516395:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788940772.519488:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944935424:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788940772.711421:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940773.025467:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940773.025499:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944935552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940773.025594:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940773.026372:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944935552 00000100:00100000:1.0:1788940773.026385:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944935552 00000100:00100000:1.0:1788940773.026482:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788940773.026495:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944935552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788940773.026534:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788940773.026601:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944935552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940773.026607:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788940773.026664:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944935552:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788940773.026769:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940773.033238:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940773.033315:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944935680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940773.033411:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940773.035939:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944935680 00000100:00100000:1.0:1788940773.035978:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944935680 00000100:00100000:1.0:1788940773.036088:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788940773.036100:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944935680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940773.036326:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788940773.036462:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944935680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 364us (3051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940773.036470:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:1.0:1788940773.036509:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940773.036569:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944935680:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788940773.537718:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 82f3b232-46da-4a78-8599-45df2ddbced0 00000020:00000080:2.0:1788940773.537733:0:9517:0:(genops.c:893:class_export_put()) final put ffff91d00c268000/82f3b232-46da-4a78-8599-45df2ddbced0 00000020:00000080:3.0:1788940773.537829:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91d00c268000/82f3b232-46da-4a78-8599-45df2ddbced0 for lustre-OST0001 00000020:00000080:3.0:1788940773.537895:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d00c269000 for lustre-OST0001 00010000:00010000:3.0:1788940773.723454:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788940774.044526:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788940774.057134:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940774.057159:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944935808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788940774.057238:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940774.057656:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944935808 00000100:00100000:0.0:1788940774.057665:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944935808 00000100:00100000:0.0:1788940774.057742:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788940774.057752:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944935808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788940774.057786:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788940774.057836:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944935808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940774.057843:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788940774.060079:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944935808:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1788940774.581235:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3fe11818-a425-4818-b40c-4d2e4f9916d8 00000001:00080000:0.0:1788940774.581253:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:0.0:1788940774.581871:0:6499:0:(genops.c:893:class_export_put()) final put ffff91d020c94000/3fe11818-a425-4818-b40c-4d2e4f9916d8 00000001:00100000:0.0:1788940774.581898:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 82f3b232-46da-4a78-8599-45df2ddbced0 00000001:00080000:0.0:1788940774.581903:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1788940774.581911:0:6499:0:(genops.c:893:class_export_put()) final put ffff91cf01ac2800/82f3b232-46da-4a78-8599-45df2ddbced0 00000020:00000080:3.0:1788940774.581960:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d020c94000/3fe11818-a425-4818-b40c-4d2e4f9916d8 for lustre-MDT0000 00000020:00000080:3.0:1788940774.582033:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf01ac2800/82f3b232-46da-4a78-8599-45df2ddbced0 for lustre-MDT0000 00000020:00000080:3.0:1788940774.582059:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d020c96000 for lustre-MDT0000 00000020:00000080:3.0:1788940774.582074:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf01ac7800 for lustre-MDT0000 00000001:00100000:1.0:1788940774.583916:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3fe11818-a425-4818-b40c-4d2e4f9916d8 00000001:00080000:1.0:1788940774.583930:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1788940774.583947:0:7452:0:(genops.c:893:class_export_put()) final put ffff91d020c93800/3fe11818-a425-4818-b40c-4d2e4f9916d8 00000001:00100000:1.0:1788940774.583964:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 82f3b232-46da-4a78-8599-45df2ddbced0 00000001:00080000:1.0:1788940774.583978:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000001:00100000:0.0:1788940774.586091:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 82f3b232-46da-4a78-8599-45df2ddbced0 00000020:00000080:0.0:1788940774.586101:0:8432:0:(genops.c:893:class_export_put()) final put ffff91cf01ac3800/82f3b232-46da-4a78-8599-45df2ddbced0 00000020:00000080:1.0:1788940774.586410:0:7452:0:(genops.c:893:class_export_put()) final put ffff91cf08456000/82f3b232-46da-4a78-8599-45df2ddbced0 00000020:00000080:1.0:1788940774.586442:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff91d020c93800/3fe11818-a425-4818-b40c-4d2e4f9916d8 for lustre-MDT0001 00000020:00000080:1.0:1788940774.586515:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf01ac3800/82f3b232-46da-4a78-8599-45df2ddbced0 for lustre-OST0000 00000020:00000080:1.0:1788940774.586541:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08456000/82f3b232-46da-4a78-8599-45df2ddbced0 for lustre-MDT0001 00000020:00000080:1.0:1788940774.586564:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d020c91800 for lustre-MDT0001 00000020:00000080:1.0:1788940774.586569:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf01ac4800 for lustre-OST0000 00000020:00000080:1.0:1788940774.586574:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf08456800 for lustre-MDT0001 00000040:00080000:3.0:1788940774.684469:0:13806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940774.684478:0:13806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940774.685015:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1788940774.685025:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:01000004:3.0:1788940774.696675:0:15161:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788940774.719393:0:15161:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788940774.719464:0:15161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053400/0x9c34acc08badd1b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd1b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.719479:0:15161:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053400/0x9c34acc08badd1b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd1b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.719486:0:15161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053400/0x9c34acc08badd1b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd1b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.719493:0:15161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d042053400/0x9c34acc08badd1b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd1b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.719513:0:15161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788940774.719518:0:15161:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788940774.719541:0:15161:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788940774.719545:0:15161:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788940774.719550:0:15161:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788940774.719574:0:15161:0:(import.c:65:import_set_state_nolock()) ffff91d034753800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788940774.719642:0:10401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940774.719649:0:10401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d042053400/0x9c34acc08badd1b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd1b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940774.719657:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875839944935936:0@lo:39:umount.0 00010000:00010000:1.0:1788940774.719657:0:10401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042053400 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940774.719661:0:10401:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d042053400/0x9c34acc08badd1b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd1b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.719669:0:10401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d042053400/0x9c34acc08badd1b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08badd1b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940774.719676:0:10401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d042053400/0x9c34acc08badd1b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08badd1b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940774.719681:0:10401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788940774.719684:0:10401:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788940774.719686:0:10401:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788940774.719711:0:10401:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d042053400/0x9c34acc08badd1b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd1b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940774.719718:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940774.719733:0:10401:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940774.719750:0:10401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d042053400/0x9c34acc08badd1b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd1b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.719756:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d042053400/0x9c34acc08badd1b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd1b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.719766:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940774.719768:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940774.719769:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940774.719780:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944936064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940774.719810:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940774.719832:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944935936 00000100:00100000:3.0:1788940774.719840:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944935936 00000100:00100000:3.0:1788940774.719954:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788940774.719968:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875839944935936:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788940774.719993:0:8517:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcd1f 00000100:00100000:2.0:1788940774.719997:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944936064 00000100:00100000:2.0:1788940774.720001:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944936064 00000100:00080000:3.0:1788940774.720007:0:8517:0:(import.c:65:import_set_state_nolock()) ffff91d02e8ef000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788940774.720033:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788940774.720039:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944936064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940774.720049:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940774.720063:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0027f7600/0x9c34acc08badd1b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badd1b0 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940774.720064:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1875839944935936:12345-0@lo:39:umount.0 Request processed in 103us (346us total) trans 0 rc 0/0 00010000:00010000:2.0:1788940774.720078:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940774.720108:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:3647:x1875839944936064:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940774.720114:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788940774.720151:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944936064:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788940774.720172:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d034753800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788940774.720179:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875839944935936:0@lo:39:umount.0 00010000:00010000:2.0:1788940774.720197:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788940774.720206:0:15161:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788940774.720208:0:15161:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788940774.720211:0:15161:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788940774.721029:0:15161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd1be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd1c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.721052:0:15161:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd1be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd1c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.721059:0:15161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd1be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd1c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.721065:0:15161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd1be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd1c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.721081:0:15161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940774.721086:0:15161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badd0c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd0c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.721092:0:15161:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badd0c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd0c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.721098:0:15161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badd0c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd0c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.721104:0:15161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badd0c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd0c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.721117:0:15161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788940774.721126:0:10401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940774.721129:0:10401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd1be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd1c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.721134:0:10401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584ce00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940774.721140:0:10401:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd1be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd1c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.721146:0:10401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd1be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08badd1c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940774.721150:0:10401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd1be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08badd1c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940774.721154:0:10401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788940774.721155:0:10401:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788940774.721169:0:10401:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd1be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd1c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.721172:0:10401:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940774.721183:0:10401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd1be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd1c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.721187:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584ce00/0x9c34acc08badd1be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd1c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.721195:0:10401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940774.721197:0:10401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badd0c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd0c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.721200:0:10401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c1c00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940774.721202:0:10401:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badd0c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd0c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.721206:0:10401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badd0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08badd0c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940774.721217:0:10401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badd0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08badd0c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940774.721220:0:10401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788940774.721221:0:10401:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788940774.721222:0:10401:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788940774.721231:0:10401:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badd0c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd0c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.721234:0:10401:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940774.721243:0:10401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badd0c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd0c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.721247:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0421c1c00/0x9c34acc08badd0c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd0c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.721253:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940774.721273:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940774.721275:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940774.721283:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940774.721293:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944936192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940774.722955:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940774.724126:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940774.724141:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944936320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940774.724175:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940774.724206:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944936192 00000100:00100000:2.0:1788940774.724213:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944936192 00000100:00100000:2.0:1788940774.724252:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944936320 00000100:00100000:2.0:1788940774.724254:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944936320 00000100:00100000:2.0:1788940774.724944:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940774.724953:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3647:x1875839944936192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940774.724964:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940774.724978:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0027f6a00/0x9c34acc08badd1c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badd1be expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940774.725381:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1788940774.725397:0:8517:0:(genops.c:893:class_export_put()) final put ffff91d02e8ea800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788940774.725449:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940774.725516:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788940774.725524:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+24:3646:x1875839944936320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940774.725532:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940774.725544:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584dc00/0x9c34acc08badd0c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badd0c2 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.725559:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940774.725613:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+23:3646:x1875839944936320:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940774.725620:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788940774.725645:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf4e294e-c65c-4988-a227-6e2e705a91d9:3646:1875839944936320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940774.725703:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940774.725732:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:3647:x1875839944936192:12345-0@lo:103:ldlm_bl.0 Request processed in 781us (2777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940774.725739:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788940774.725756:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944936192:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940774.726313:0:15161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08badd426 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd42d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.726341:0:15161:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08badd426 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd42d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.726347:0:15161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08badd426 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd42d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.726351:0:15161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08badd426 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd42d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.726367:0:15161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940774.726374:0:15161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c1e00/0x9c34acc08badcc7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcc85 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.726380:0:15161:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c1e00/0x9c34acc08badcc7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcc85 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.726384:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940774.726386:0:15161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0421c1e00/0x9c34acc08badcc7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badcc85 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.726390:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08badd426 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd42d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.726392:0:15161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d0421c1e00/0x9c34acc08badcc7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badcc85 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.726398:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7e00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940774.726402:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08badd426 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd42d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.726405:0:15161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788940774.726408:0:15161:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1788940774.726411:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08badd426 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08badd42d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940774.726411:0:15161:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:00010000:3.0:1788940774.726417:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08badd426 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08badd42d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940774.726437:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788940774.726439:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788940774.726441:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788940774.726465:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08badd426 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd42d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.726472:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940774.726497:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08badd426 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd42d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.726504:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08badd426 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd42d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.726513:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940774.726515:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0421c1e00/0x9c34acc08badcc7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badcc85 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788940774.726516:0:15161:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00010000:00010000:3.0:1788940774.726521:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0421c1e00 already unused, calling callback (ffffffffc12d7c20) 00000020:01000000:0.0:1788940774.726521:0:15161:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 10000000:00010000:3.0:1788940774.726524:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c1e00/0x9c34acc08badcc7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badcc85 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788940774.726525:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1788940774.726530:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0421c1e00/0x9c34acc08badcc7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08badcc85 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788940774.726531:0:15161:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/11 10000000:00010000:3.0:1788940774.726537:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0421c1e00/0x9c34acc08badcc7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08badcc85 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788940774.726540:0:15161:0:(genops.c:1827:print_export_data()) lustre-MDT0000: ACTIVE ffff91cf07a1f000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:3.0:1788940774.726542:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788940774.726544:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788940774.726546:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00080000:0.0:1788940774.726546:0:15161:0:(genops.c:1827:print_export_data()) lustre-MDT0000: ACTIVE ffff91cf060e2800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788940774.726550:0:15161:0:(genops.c:1827:print_export_data()) lustre-MDT0000: ACTIVE ffff91d03566f000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788940774.726554:0:15161:0:(genops.c:1827:print_export_data()) lustre-MDT0000: ACTIVE ffff91d004631800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00010000:00010000:3.0:1788940774.726558:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0421c1e00/0x9c34acc08badcc7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badcc85 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788940774.726559:0:15161:0:(genops.c:1561:class_disconnect_exports()) OBD device 5 (ffff91d00509cd88) has exports, disconnecting them 00010000:00010000:3.0:1788940774.726563:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1788940774.726564:0:15161:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91cf07a1f000), last request at 1788940769 00010000:00010000:3.0:1788940774.726574:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0421c1e00/0x9c34acc08badcc7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badcc85 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.726580:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0421c1e00/0x9c34acc08badcc7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badcc85 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788940774.726582:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd02f 00000100:00080000:0.0:1788940774.726597:0:15161:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d7800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788940774.726600:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940774.726602:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940774.726605:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940774.726611:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940774.726622:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944936448:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788940774.726641:0:15161:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91cf07a1f000): rc 0 00000020:00000080:0.0:1788940774.726644:0:15161:0:(genops.c:893:class_export_put()) final put ffff91cf07a1f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788940774.726649:0:15161:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91cf060e2800), last request at 1788940769 00000020:00000080:0.0:1788940774.726652:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcf09 00000100:00080000:0.0:1788940774.726657:0:15161:0:(import.c:65:import_set_state_nolock()) ffff91cf060e6000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788940774.726661:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788940774.726666:0:15161:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91cf060e2800): rc 0 00000020:00000080:0.0:1788940774.726668:0:15161:0:(genops.c:893:class_export_put()) final put ffff91cf060e2800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788940774.726672:0:15161:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91d03566f000), last request at 1788940490 00000020:00000080:0.0:1788940774.726675:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badce06 00000100:00080000:0.0:1788940774.726677:0:15161:0:(import.c:65:import_set_state_nolock()) ffff91d03566a800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788940774.726683:0:15161:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d03566f000): rc 0 00000020:00000080:0.0:1788940774.726684:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d03566f000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788940774.726688:0:15161:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91d004631800), last request at 1788940490 00000020:00000080:0.0:1788940774.726691:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcdd5 00000100:00080000:0.0:1788940774.726694:0:15161:0:(import.c:65:import_set_state_nolock()) ffff91d02ebf3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788940774.726700:0:15161:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00100000:3.0:1788940774.726701:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944936448 00000100:00100000:3.0:1788940774.726706:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944936448 00000100:00100000:3.0:1788940774.726739:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788940774.726745:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+21:3645:x1875839944936448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940774.726754:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940774.726764:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d035936c00/0x9c34acc08badd42d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badd426 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.726775:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:0.0:1788940774.726784:0:15161:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d004631800): rc 0 00000004:00000080:0.0:1788940774.726790:0:15161:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9d5848063ae0 00000100:00100000:3.0:1788940774.726802:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:3645:x1875839944936448:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940774.726807:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788940774.726809:0:15161:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788940774.726817:0:15161:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1788940774.726822:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940774.726838:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944936448:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940774.726849:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940774.726855:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944936576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940774.726878:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788940774.727090:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02e8ea800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788940774.727133:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf07a1f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788940774.727160:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf060e2800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788940774.727182:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03566f000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788940774.727215:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d02e8ef000 for lustre-MDT0000 00000020:00000080:1.0:1788940774.727220:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d02e8d7800 for lustre-MDT0000 00000020:00000080:1.0:1788940774.727223:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf060e6000 for lustre-MDT0000 00000020:00000080:1.0:1788940774.727226:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d03566a800 for lustre-MDT0000 00000100:00100000:2.0:1788940774.730829:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944936576 00000100:00100000:2.0:1788940774.730843:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944936576 00000100:00100000:2.0:1788940774.730928:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788940774.730939:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+20:3647:x1875839944936576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940774.730954:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940774.730973:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d000031800/0x9c34acc08badcc85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badcc7e expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788940774.731550:0:15161:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788940774.731577:0:15161:0:(import.c:65:import_set_state_nolock()) ffff91d004634000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788940774.731630:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944936704:0@lo:39:umount.0 00000100:00100000:0.0:1788940774.731700:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940774.731811:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944936704 00000100:00100000:1.0:1788940774.731816:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944936704 00010000:00010000:2.0:1788940774.731824:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940774.731891:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:3647:x1875839944936576:12345-0@lo:103:ldlm_bl.0 Request processed in 938us (4995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940774.731894:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788940774.731899:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788940774.731902:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875839944936704:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788940774.731926:0:6526:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badce61 00000100:00080000:1.0:1788940774.731933:0:6526:0:(import.c:65:import_set_state_nolock()) ffff91d03577a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788940774.731954:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1788940774.731998:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940774.732023:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944936576:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788940774.732293:0:15161:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788940774.732296:0:15161:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1788940774.732312:0:15161:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788940774.732370:0:15161:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788940774.732390:0:15161:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d1000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788940774.732455:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940774.732558:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944936832:0@lo:9:umount.0 00000100:00100000:0.0:1788940774.732589:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940774.732639:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944936832 00000100:00100000:3.0:1788940774.732661:0:8524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944936832 00000100:00100000:3.0:1788940774.732700:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788940774.732710:0:8524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875839944936832:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788940774.732730:0:8524:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcfb1 00000100:00080000:3.0:1788940774.732735:0:8524:0:(import.c:65:import_set_state_nolock()) ffff91cf06129000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788940774.732774:0:8524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788940774.732876:0:8524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3644:x1875839944936832:12345-0@lo:9:umount.0 Request processed in 165us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940774.732883:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:3.0:1788940774.733925:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788940774.734527:0:15161:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788940774.734533:0:15161:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1788940774.734551:0:15161:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788940774.734552:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3644:x1875839944936704:12345-0@lo:39:umount.0 Request processed in 2644us (2845us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788940774.734566:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1788940774.734614:0:15161:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788940774.734639:0:15161:0:(import.c:65:import_set_state_nolock()) ffff91cf08451800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788940774.734673:0:15161:0:(genops.c:1566:class_disconnect_exports()) OBD device 5 (ffff91d00509cd88) has no exports 00000100:00080000:0.0:1788940774.734948:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d004634000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788940774.734956:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944936704:0@lo:39:umount.0 00000100:00100000:0.0:1788940774.734973:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944936960:0@lo:9:umount.0 00000100:00100000:0.0:1788940774.735021:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788940774.735067:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d1000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788940774.735072:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944936960 00000004:00080000:0.0:1788940774.735073:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788940774.735075:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788940774.735079:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944936832:0@lo:9:umount.0 00000100:00100000:1.0:1788940774.735081:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944936960 00000100:00100000:1.0:1788940774.735148:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788940774.735159:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875839944936960:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788940774.735181:0:8437:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd0f3 00000100:00080000:1.0:1788940774.735190:0:8437:0:(import.c:65:import_set_state_nolock()) ffff91cf08453000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788940774.735231:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788940774.735413:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3644:x1875839944936960:12345-0@lo:9:umount.0 Request processed in 256us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940774.735431:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1788940774.735443:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf08451800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788940774.735454:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788940774.735457:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788940774.735462:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788940774.735465:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944936960:0@lo:9:umount.0 00010000:00010000:1.0:1788940774.735468:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788940774.745689:0:15161:0:(genops.c:1566:class_disconnect_exports()) OBD device 5 (ffff91d00509cd88) has no exports 00000020:00000080:2.0:1788940774.778199:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badccd9 00000020:00000080:2.0:1788940774.778217:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d03474d800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788940774.778237:0:15161:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00010000:00010000:1.0:1788940774.778670:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788940774.778993:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03474d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788940774.779018:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940774.779029:0:15161:0:(obd_config.c:1048:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788940774.779034:0:15161:0:(genops.c:1566:class_disconnect_exports()) OBD device 7 (ffff91d03ec58000) has no exports 00000020:00000080:3.0:1788940774.780859:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badccd2 00000020:00000080:3.0:1788940774.780877:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d03473c800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788940774.780918:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03473c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788940774.780950:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940774.780961:0:15161:0:(obd_config.c:958:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788940774.780963:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d004637800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788940774.780965:0:15161:0:(genops.c:852:class_export_destroy()) destroying export ffff91d004637800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788940774.780969:0:15161:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:2.0:1788940775.067634:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944937472:0@lo:400:kworker.0 00000100:00100000:2.0:1788940775.067692:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940775.067736:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944937984:0@lo:400:kworker.0 00000100:00100000:2.0:1788940775.067754:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940775.067774:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788940775.067778:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944937088:0@lo:400:kworker.0 00000100:00100000:2.0:1788940775.067792:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940775.067802:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944937600:0@lo:400:kworker.0 00000100:00100000:2.0:1788940775.067814:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940775.067825:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944938112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940775.067838:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940775.067932:0:7798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944937088 00000100:00100000:0.0:1788940775.067939:0:7798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944937088 00000100:00100000:0.0:1788940775.067970:0:7798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788940775.067976:0:7798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875839944937088:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788940775.067991:0:7798:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788940775.068032:0:7798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875839944937088:12345-0@lo:400:kworker.0 Request processed in 54us (236us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788940775.068039:0:7798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788940775.068086:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944937984 00000100:00100000:0.0:1788940775.068101:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944937984 00000100:00100000:0.0:1788940775.068128:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944937600 00000100:00100000:0.0:1788940775.068130:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944937600 00000100:00100000:0.0:1788940775.068143:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788940775.068147:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944937984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940775.068178:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944937984:12345-0@lo:400:kworker.0 Request processed in 31us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940775.068182:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788940775.068189:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788940775.068192:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944937600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940775.068207:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944937600:12345-0@lo:400:kworker.0 Request processed in 15us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940775.068211:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1788940775.068224:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940775.068226:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940775.068345:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944937472 00000100:00100000:1.0:1788940775.068349:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944937472 00000100:00100000:1.0:1788940775.068381:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1788940775.068386:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944937472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940775.068411:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944937472:12345-0@lo:400:kworker.0 Request processed in 26us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940775.068415:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1788940775.068507:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944937216:0@lo:400:kworker.0 00000100:00100000:3.0:1788940775.068532:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940775.068557:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944937728:0@lo:400:kworker.0 00000100:00100000:3.0:1788940775.068570:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940775.068586:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788940775.068590:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944937344:0@lo:400:kworker.0 00000100:00100000:3.0:1788940775.068602:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940775.068620:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944937856:0@lo:400:kworker.0 00000100:00100000:3.0:1788940775.068633:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940775.068654:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944937216 00000100:00100000:3.0:1788940775.068657:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944937216 00000100:00100000:3.0:1788940775.068670:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944937728 00000100:00100000:3.0:1788940775.068671:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944937728 00000100:00100000:3.0:1788940775.068676:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944937344 00000100:00100000:3.0:1788940775.068677:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944937344 00000100:00100000:3.0:1788940775.068681:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944937856 00000100:00100000:3.0:1788940775.068683:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944937856 00000100:00100000:3.0:1788940775.068693:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1788940775.068696:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944937856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940775.068718:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944937856:12345-0@lo:400:kworker.0 Request processed in 22us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940775.068722:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1788940775.068730:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788940775.068732:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875839944937216:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788940775.068735:0:8517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788940775.068748:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875839944937216:12345-0@lo:400:kworker.0 Request processed in 15us (215us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788940775.068752:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788940775.068757:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788940775.068759:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875839944937728:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788940775.068762:0:8517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788940775.068773:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875839944937728:12345-0@lo:400:kworker.0 Request processed in 13us (203us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788940775.068777:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788940775.068781:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788940775.068789:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875839944937344:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788940775.068792:0:8517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788940775.068804:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875839944937344:12345-0@lo:400:kworker.0 Request processed in 15us (201us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788940775.068808:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1788940775.068831:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788940775.068835:0:3645:0:(import.c:65:import_set_state_nolock()) ffff91cf060e3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788940775.068838:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00010000:00080000:2.0:1788940775.068980:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf079eb800 x1875839944937472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940775.068991:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944937472:0@lo:400:kworker.0 00000100:00100000:2.0:1788940775.069003:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944937984:0@lo:400:kworker.0 00000100:00080000:2.0:1788940775.069056:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788940775.069060:0:3647:0:(import.c:65:import_set_state_nolock()) ffff91d004280000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788940775.069063:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788940775.069068:0:3647:0:(import.c:65:import_set_state_nolock()) ffff91d004280000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940775.069071:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 246 00000100:00080000:2.0:1788940775.069076:0:3647:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff91d004280000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788940775.069096:0:3647:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d018b0aa00 x1875839944938240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940775.069111:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944937088:0@lo:400:kworker.0 00000100:00100000:2.0:1788940775.069121:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944937600:0@lo:400:kworker.0 00000100:00100000:2.0:1788940775.069140:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944938112 00000100:00100000:2.0:1788940775.069143:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944938112 00000100:00100000:2.0:1788940775.069163:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788940775.069167:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944938112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788940775.069189:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788940775.069217:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944938112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940775.069221:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788940775.069243:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944938112:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788940775.069454:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788940775.069468:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944938240:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788940775.069497:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940775.070198:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944938240 00000100:00100000:1.0:1788940775.070204:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944938240 00000100:00100000:1.0:1788940775.070233:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788940775.070238:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875839944938240:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788940775.070278:0:6526:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1788940775.074183:0:3645:0:(import.c:65:import_set_state_nolock()) ffff91cf060e3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940775.074197:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 270 00000100:00080000:3.0:1788940775.074208:0:3645:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91cf060e3800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940775.074308:0:3645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf07846680 x1875839944938368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940775.074364:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944937344:0@lo:400:kworker.0 00010000:00080000:3.0:1788940775.074430:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf079e9c00 x1875839944937856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940775.074444:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944937856:0@lo:400:kworker.0 00000100:00080000:3.0:1788940775.074466:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788940775.074471:0:3645:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788940775.074474:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788940775.074478:0:3645:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940775.074482:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 246 00000100:00080000:3.0:1788940775.074488:0:3645:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff91d02e8d3000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940775.074523:0:3645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d034758e00 x1875839944938496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940775.074532:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944937216:0@lo:400:kworker.0 00000100:00080000:3.0:1788940775.074546:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788940775.074550:0:3645:0:(import.c:65:import_set_state_nolock()) ffff91cf07a1e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788940775.074552:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788940775.074555:0:3645:0:(import.c:65:import_set_state_nolock()) ffff91cf07a1e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940775.074558:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 297 00000100:00080000:3.0:1788940775.074561:0:3645:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91cf07a1e800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940775.074573:0:3645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d020c8c000 x1875839944938624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940775.074582:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944937728:0@lo:400:kworker.0 00000100:00100000:2.0:1788940775.074694:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875839944938368:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788940775.074765:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940775.074816:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875839944938496:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788940775.074839:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940775.075093:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875839944938624:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788940775.075105:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944938368 00000100:00100000:0.0:1788940775.075112:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944938368 00000100:00100000:2.0:1788940775.075114:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940775.075144:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944938496 00000100:00100000:0.0:1788940775.075147:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944938496 00000100:00100000:2.0:1788940775.075149:0:9713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944938624 00000100:00100000:2.0:1788940775.075152:0:9713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944938624 00000100:00100000:0.0:1788940775.075165:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788940775.075174:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875839944938368:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788940775.075189:0:6520:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788940775.075225:0:9713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788940775.075231:0:9713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1875839944938496:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788940775.075236:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875839944938368:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 62us (471us total) trans 0 rc -19/-19 00010000:02000000:2.0:1788940775.075238:0:9713:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788940775.075243:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788940775.075289:0:9713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1875839944938496:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 56us (448us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788940775.075372:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788940775.075378:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875839944938624:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788940775.075385:0:6520:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788940775.075412:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875839944938624:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 33us (296us total) trans 0 rc -19/-19 00000100:00080000:3.0:1788940775.075441:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf060e3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940775.075446:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788940775.075449:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875839944938368:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1788940775.075457:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940775.075460:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788940775.075463:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875839944938496:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1788940775.075469:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf07a1e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940775.075472:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788940775.075474:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875839944938624:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788940775.075494:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788940775.075524:0:9713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788940775.081095:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875839944938240:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 10846us (11586us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788940775.081109:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1788940775.081605:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d004280000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940775.081625:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788940775.081629:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944938240:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1788940775.835575:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940776.861038:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940777.885725:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940778.139929:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944938752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940778.139997:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940778.140168:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944938752 00000100:00100000:1.0:1788940778.140177:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944938752 00000100:00100000:1.0:1788940778.140242:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788940778.140252:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944938752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788940778.140298:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788940778.140348:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944938752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940778.140355:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:0.0:1788940778.140453:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940778.140535:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944938752:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788940778.907668:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940779.931496:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940780.187484:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940780.187507:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944938880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940780.187577:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940780.187839:0:9962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944938880 00000100:00100000:1.0:1788940780.187847:0:9962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944938880 00000100:00100000:1.0:1788940780.187904:0:9962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788940780.187914:0:9962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944938880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788940780.187944:0:9962:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788940780.187990:0:9962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944938880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940780.187996:0:9962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:1.0:1788940780.188034:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940780.188916:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788940780.188921:0:36:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788940780.188924:0:36:0:(import.c:65:import_set_state_nolock()) ffff91d004280000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940780.188944:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 530 00000100:00080000:1.0:1788940780.188949:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788940780.188955:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff91d004280000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940780.188977:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944939008:0@lo:400:kworker.0 00000100:00100000:1.0:1788940780.188981:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf079e9c00 x1875839944939136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940780.189002:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788940780.189006:0:36:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788940780.189008:0:36:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940780.189011:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 530 00000100:00080000:1.0:1788940780.189014:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788940780.189018:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff91d02e8d3000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940780.189032:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf079eb480 x1875839944939264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940780.189034:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788940780.189045:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788940780.189049:0:36:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788940780.189051:0:36:0:(import.c:65:import_set_state_nolock()) ffff91cf060e3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940780.189055:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 530 00000100:00080000:1.0:1788940780.189058:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788940780.189062:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91cf060e3800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940780.189072:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf079e8e00 x1875839944939392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940780.189097:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944939008 00000100:00080000:1.0:1788940780.189098:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788940780.189103:0:36:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1788940780.189105:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944939008 00000100:00080000:1.0:1788940780.189105:0:36:0:(import.c:65:import_set_state_nolock()) ffff91cf07a1e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940780.189116:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 530 00000100:00080000:1.0:1788940780.189119:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788940780.189123:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91cf07a1e800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940780.189136:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf079eb800 x1875839944939776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940780.189148:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1788940780.189160:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03990b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:3647:x1875839944939008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940780.189177:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944939520:0@lo:400:kworker.0 00000100:00100000:2.0:1788940780.189207:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03990b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf4e294e-c65c-4988-a227-6e2e705a91d9+19:3647:x1875839944939008:12345-0@lo:400:kworker.0 Request processed in 49us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940780.189217:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1788940780.189219:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940780.189303:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944939136:0@lo:38:kworker.0 00000100:00100000:2.0:1788940780.189332:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940780.189391:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944938880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940780.189413:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944939648:0@lo:400:kworker.0 00000100:00100000:0.0:1788940780.189450:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940780.189605:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944939008:0@lo:400:kworker.0 00000100:00100000:3.0:1788940780.189627:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944939520 00000100:00100000:3.0:1788940780.189631:0:8517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944939520 00000100:00100000:3.0:1788940780.189666:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1788940780.189673:0:8517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944939520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940780.189707:0:8517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944939520:12345-0@lo:400:kworker.0 Request processed in 34us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940780.189713:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00080000:3.0:1788940780.189733:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788940780.189751:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944939904:0@lo:400:kworker.0 00000100:00100000:3.0:1788940780.189774:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940780.189802:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944939904 00000100:00100000:3.0:1788940780.189805:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944939904 00000100:00100000:3.0:1788940780.189834:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1788940780.189840:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944939904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940780.189871:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944939904:12345-0@lo:400:kworker.0 Request processed in 32us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940780.190026:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00010000:00080000:3.0:1788940780.190052:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf079ea680 x1875839944939904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940780.190061:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944939904:0@lo:400:kworker.0 00000100:00080000:3.0:1788940780.190073:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788940780.190089:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944939136 00000100:00100000:3.0:1788940780.190092:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944939136 00000100:00100000:3.0:1788940780.190109:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788940780.190113:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875839944939136:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788940780.190127:0:6525:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:00080000:1.0:1788940780.191841:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf079e8380 x1875839944939520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940780.191856:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944939520:0@lo:400:kworker.0 00000100:00100000:1.0:1788940780.191911:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944939648 00000100:00100000:1.0:1788940780.191918:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944939648 00000100:00100000:1.0:1788940780.191975:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788940780.191983:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944939648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940780.192044:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944939648:12345-0@lo:400:kworker.0 Request processed in 61us (2593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940780.192050:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:1.0:1788940780.192097:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940780.193090:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875839944939136:12345-0@lo:38:kworker.0 Request processed in 2971us (3754us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788940780.193101:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:2.0:1788940780.193330:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d004280000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788940780.193336:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788940780.193341:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944939136:0@lo:38:kworker.0 00000100:00100000:2.0:1788940780.193351:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875839944939264:0@lo:38:kworker.0 00000100:00100000:2.0:1788940780.193401:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940780.193430:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875839944939392:0@lo:38:kworker.0 00000100:00100000:2.0:1788940780.193454:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940780.193501:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875839944939776:0@lo:38:kworker.0 00000100:00100000:2.0:1788940780.193525:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940780.193572:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944939264 00000100:00100000:2.0:1788940780.193577:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944939264 00000100:00100000:2.0:1788940780.193602:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944939392 00000100:00100000:2.0:1788940780.193605:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944939392 00000100:00100000:2.0:1788940780.193621:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944939776 00000100:00100000:2.0:1788940780.193623:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944939776 00000100:00100000:2.0:1788940780.193634:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788940780.193640:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875839944939264:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788940780.193656:0:6522:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788940780.193686:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875839944939264:12345-0@lo:38:kworker.0 Request processed in 45us (285us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788940780.193693:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788940780.193704:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788940780.193708:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875839944939392:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788940780.193714:0:6522:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788940780.193733:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875839944939392:12345-0@lo:38:kworker.0 Request processed in 24us (279us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788940780.193737:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788940780.193745:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788940780.193748:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875839944939776:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788940780.193753:0:6522:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788940780.193771:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875839944939776:12345-0@lo:38:kworker.0 Request processed in 21us (245us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788940780.193776:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:2.0:1788940780.193801:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788940780.193805:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788940780.193814:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875839944939264:0@lo:38:kworker.0 00000100:00080000:2.0:1788940780.193825:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf060e3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788940780.193828:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788940780.193831:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875839944939392:0@lo:38:kworker.0 00000100:00080000:2.0:1788940780.193839:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf07a1e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788940780.193842:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788940780.193845:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875839944939776:0@lo:38:kworker.0 00000100:00100000:0.0:1788940780.194103:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944939648:0@lo:400:kworker.0 00000001:00100000:2.0:1788940780.700932:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788940780.700949:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1788940780.700955:0:7452:0:(genops.c:893:class_export_put()) final put ffff91d034748000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788940780.701038:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff91d034748000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:2.0:1788940780.701040:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788940780.701045:0:9517:0:(genops.c:893:class_export_put()) final put ffff91cf08450000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788940780.701159:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08450000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788940780.701177:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d03577a800 for lustre-MDT0001 00000020:00000080:1.0:1788940780.701182:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf08453000 for lustre-OST0001 00000001:00100000:0.0:1788940780.702762:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788940780.702767:0:6499:0:(genops.c:893:class_export_put()) final put ffff91d004631800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788940780.702779:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788940780.702782:0:8432:0:(genops.c:893:class_export_put()) final put ffff91cf0612c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788940780.702845:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d004631800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788940780.702891:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf0612c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788940780.702921:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d02ebf3000 for lustre-MDT0000 00000020:00000080:3.0:1788940780.702928:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf06129000 for lustre-OST0000 00000020:01000000:3.0:1788940780.827479:0:15161:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d035bae600 - data ffff91d041344d80/ffff91d035814000 00000020:01000000:3.0:1788940780.827635:0:15161:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d005f51580 - data ffff91d04102e360/ffff91d0346ed400 00000001:00000004:3.0:1788940780.834713:0:15161:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:2.0:1788940780.869876:0:15161:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788940780.869885:0:15161:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788940780.869904:0:15161:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff91cf07846300 x1875839944936704/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788940784 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940780.869939:0:15161:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788940780.871777:0:15161:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788940780.871784:0:15161:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1788940780.871950:0:15161:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788940780.871954:0:15161:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788940780.878186:0:8522:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788940780.878195:0:8522:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1788940780.878212:0:8522:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788940780.878896:0:15161:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788940780.878902:0:15161:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1788940780.878916:0:15161:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788940780.878919:0:15161:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788940780.879566:0:9802:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788940780.879570:0:9802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1788940780.879581:0:9802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788940780.888603:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcca1 00000020:00000080:2.0:1788940780.888749:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d004635000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788940780.894348:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d004635000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788940780.896351:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badccb6 00000020:00000080:2.0:1788940780.896759:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d004633000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788940780.896810:0:15161:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788940780.896817:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940780.896827:0:15161:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788940780.896830:0:15161:0:(genops.c:1566:class_disconnect_exports()) OBD device 4 (ffff91d005098000) has no exports 00000004:01000000:2.0:1788940780.897057:0:15161:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788940780.897068:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd0ec 00000020:00000080:2.0:1788940780.897073:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d02ebf2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788940780.900073:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d004633000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788940780.903507:0:15161:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788940780.903523:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940780.903540:0:15161:0:(obd_config.c:1048:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788940780.903545:0:15161:0:(genops.c:1566:class_disconnect_exports()) OBD device 28 (ffff91cf0844b3b0) has no exports 00000020:00000080:2.0:1788940780.903557:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd0e5 00000020:00000080:2.0:1788940780.903567:0:15161:0:(genops.c:893:class_export_put()) final put ffff91cf08457800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788940780.903597:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02ebf2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1788940780.904327:0:15161:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788940780.904333:0:15161:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788940780.904339:0:15161:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1788940780.904346:0:15161:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788940780.904349:0:15161:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788940780.904573:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08457800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788940780.904835:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940780.904850:0:15161:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788940780.904859:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcfaa 00000020:00000080:2.0:1788940780.904868:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d037771800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788940780.905002:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf08451800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788940780.905009:0:37:0:(genops.c:893:class_export_put()) final put ffff91d037821000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788940780.905011:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d037821000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788940780.905017:0:37:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788940780.905167:0:15161:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788940780.905173:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940780.905179:0:15161:0:(obd_config.c:1048:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788940780.905184:0:15161:0:(genops.c:1566:class_disconnect_exports()) OBD device 22 (ffff91d035608000) has no exports 00000020:00000080:2.0:1788940780.905189:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcfa3 00000020:00000080:2.0:1788940780.905194:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d02e8d7000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788940780.905216:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d037771800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1788940780.906089:0:15161:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788940780.906104:0:15161:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788940780.906107:0:15161:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1788940780.906113:0:15161:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788940780.906115:0:15161:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788940780.906169:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02e8d7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788940780.906291:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940780.906301:0:15161:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788940780.906317:0:15161:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788940780.906324:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badce5a 00000020:00000080:2.0:1788940780.906330:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d035759000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788940780.906498:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d02e8d1000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788940780.906505:0:37:0:(genops.c:893:class_export_put()) final put ffff91cf060e4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788940780.906507:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf060e4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788940780.906512:0:37:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788940780.907107:0:15161:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788940780.907113:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940780.907120:0:15161:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788940780.907124:0:15161:0:(genops.c:1566:class_disconnect_exports()) OBD device 15 (ffff91d004644d88) has no exports 00000020:00000080:2.0:1788940780.907130:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badce53 00000020:00000080:2.0:1788940780.907135:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d03575c000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788940780.907161:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d035759000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788940780.907397:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03575c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788940780.917531:0:15161:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788940780.917541:0:15161:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788940780.917546:0:15161:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788940780.917555:0:15161:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788940780.917655:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940780.917670:0:15161:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788940780.917711:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940780.917715:0:15161:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788940780.917721:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d03ece4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788940780.917725:0:15161:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03ece4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788940780.917738:0:15161:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788940780.917952:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badccbd 00000020:00000080:2.0:1788940780.917960:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d004630000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788940780.918035:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d004634000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788940780.918043:0:37:0:(genops.c:893:class_export_put()) final put ffff91d03575e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788940780.918045:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03575e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788940780.918049:0:37:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788940780.918168:0:15161:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788940780.918173:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940780.918179:0:15161:0:(obd_config.c:1048:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788940780.918184:0:15161:0:(genops.c:1566:class_disconnect_exports()) OBD device 6 (ffff91d0046419d8) has no exports 00000020:00000080:2.0:1788940780.918217:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940780.918222:0:15161:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788940780.918236:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badccc4 00000020:00000080:2.0:1788940780.918241:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d004631000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788940780.918381:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d004630000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788940780.918385:0:37:0:(genops.c:893:class_export_put()) final put ffff91d004636000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788940780.918391:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d004636000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788940780.918395:0:37:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1788940780.918528:0:15161:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d004f4a000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788940780.918533:0:15161:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d004f4a000 3 00000020:01000004:2.0:1788940780.918536:0:15161:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91d004f4a000 from lustre-MDT0000 00000020:00000080:2.0:1788940780.918554:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940780.918558:0:15161:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788940780.918561:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d004635800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788940780.918563:0:15161:0:(genops.c:852:class_export_destroy()) destroying export ffff91d004635800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788940780.918570:0:15161:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788940780.918662:0:15161:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788940780.918667:0:15161:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788940780.918671:0:15161:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788940780.918674:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940780.918688:0:15161:0:(obd_config.c:1048:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788940780.918695:0:15161:0:(genops.c:1827:print_export_data()) MGS: ACTIVE ffff91d039a42800 bf4e294e-c65c-4988-a227-6e2e705a91d9 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788940780.918701:0:15161:0:(genops.c:1561:class_disconnect_exports()) OBD device 1 (ffff91d03ec599d8) has exports, disconnecting them 00000020:00080000:2.0:1788940780.918706:0:15161:0:(genops.c:1536:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff91d039a42800), last request at 1788940467 00000020:00000080:2.0:1788940780.918722:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcc62 00000020:00010000:2.0:1788940780.918726:0:15161:0:(genops.c:1929:obd_stale_export_put()) Put export ffff91d039a42800: total 1 00000100:00080000:2.0:1788940780.918730:0:15161:0:(import.c:65:import_set_state_nolock()) ffff91d039a43800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788940780.918753:0:15161:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d039a42800): rc 0 00000020:00080000:2.0:1788940780.918757:0:15161:0:(genops.c:1566:class_disconnect_exports()) OBD device 1 (ffff91d03ec599d8) has no exports 00000100:00100000:2.0:1788940780.918815:0:6515:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff91d0050ef400:6515] 2 exiting: rc = 0 00000100:00100000:2.0:1788940780.918906:0:6513:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff91d02d3f0c00:6513] 1 exiting: rc = 0 00000100:00100000:2.0:1788940780.919150:0:6512:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff91d02d3f0800:6512] 0 exiting: rc = 1 00000100:00100000:2.0:1788940780.919204:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919211:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919216:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919234:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:0.0:1788940780.919287:0:6508:0:(genops.c:1915:obd_stale_export_get()) Get export ffff91d039a42800: total 1 00010000:00010000:0.0:1788940780.919343:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91d039a42800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788940780.919383:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaab200/0x9c34acc08badd1a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badd1a2 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.919413:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d042053c00/0x9c34acc08badcd5e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badcd57 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.919427:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d042053600/0x9c34acc08badcd6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badcd65 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.919440:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaab800/0x9c34acc08badd1d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badd1cc expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.919450:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584cc00/0x9c34acc08badd163 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badd15c expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.919460:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaaae00/0x9c34acc08badd17f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badd178 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.919470:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584c000/0x9c34acc08badd3fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badd3f5 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.919480:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d042052c00/0x9c34acc08badd171 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badd16a expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.919491:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d035937000/0x9c34acc08badd41f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badd418 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.919501:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaaaa00/0x9c34acc08badd083 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badd07c expref: 5 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.919511:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584d000/0x9c34acc08badd18d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badd186 expref: 4 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.919531:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d004602a00/0x9c34acc08badd40a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badd403 expref: 3 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.919544:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02eaaac00/0x9c34acc08badd19b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08badd194 expref: 2 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.919554:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91d039a42800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788940780.919569:0:6508:0:(genops.c:893:class_export_put()) final put ffff91d039a42800/bf4e294e-c65c-4988-a227-6e2e705a91d9 00000100:00100000:2.0:1788940780.919639:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919649:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919655:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919660:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919666:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919672:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919686:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919691:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919697:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919727:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919733:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919739:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919744:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919750:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919755:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919761:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919768:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919774:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919780:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919786:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919792:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919797:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919802:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919808:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919813:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919819:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919825:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919830:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919835:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919841:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919847:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919852:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919858:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919863:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919877:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919882:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919888:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919894:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919899:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919905:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919910:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919916:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.919921:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.920164:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.920176:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.920185:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.920194:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.920200:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.920205:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.920211:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.920217:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.920231:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.920237:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.920243:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.920249:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.920254:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.920287:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.920298:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.920304:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940780.920309:0:15161:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788940780.922647:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d004631000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788940780.923168:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940780.923172:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940780.923175:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788940780.923223:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d039a42800/bf4e294e-c65c-4988-a227-6e2e705a91d9 for MGS 00000020:00000080:1.0:1788940780.923295:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d039a43800 for MGS 00000020:01000000:2.0:1788940780.923596:0:15161:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d035a02e80 - data ffff91cf064405e8/ffff91d02e9ca800 00000020:01000000:2.0:1788940780.923828:0:15161:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d040fe3d80 - data ffff91d04105eca8/ffff91d005085800 00000020:00000080:2.0:1788940780.924456:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcc46 00000020:00000080:2.0:1788940780.924467:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d03ed27800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788940780.924512:0:15161:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d004f4a000 from MGS, refs=2 00000020:01000004:2.0:1788940780.924516:0:15161:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d004f4a000 2 00000020:01000004:2.0:1788940780.924520:0:15161:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91d004f4a000 from MGS 00000020:00000080:2.0:1788940780.924543:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940780.924560:0:15161:0:(obd_config.c:958:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788940780.924563:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d03ed22000/MGS 00000020:00000080:2.0:1788940780.924566:0:15161:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03ed22000/MGS for MGS 00000020:01000000:2.0:1788940780.924572:0:15161:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788940780.924655:0:15161:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788940780.924659:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940780.924664:0:15161:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788940780.924671:0:15161:0:(genops.c:1827:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff91d03ece7800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788940780.924743:0:15161:0:(genops.c:1561:class_disconnect_exports()) OBD device 8 (ffff91d03ec5cd88) has exports, disconnecting them 00000020:00080000:2.0:1788940780.924748:0:15161:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff91d03ece7800), last request at 1788940468 00000020:00000080:2.0:1788940780.924756:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcd11 00000020:00080000:2.0:1788940780.924767:0:15161:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d03ece7800): rc 0 00000020:00000080:2.0:1788940780.924771:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d03ece7800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788940780.924812:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03ed27800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788940780.925853:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03ece7800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788940780.928372:0:15161:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788940780.928379:0:15161:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788940780.928387:0:15161:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788940780.928394:0:15161:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788940780.928560:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940780.928568:0:15161:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788940780.928575:0:15161:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d004f4a000 1 00000020:00000080:0.0:1788940780.928581:0:15161:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcc38 00000020:00000080:0.0:1788940780.928589:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d005fc2800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788940780.928594:0:15161:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788940780.928599:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940780.928608:0:15161:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788940780.928615:0:15161:0:(genops.c:1566:class_disconnect_exports()) OBD device 0 (ffff91d0050e4d88) has no exports 00000020:00000080:1.0:1788940780.930210:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d034753800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788940780.930227:0:36:0:(genops.c:893:class_export_put()) final put ffff91d034757000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788940780.930231:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff91d034757000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788940780.930241:0:36:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788940780.930381:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffff91d005fc2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788940780.983071:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788940780.989960:0:15161:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940780.989973:0:15161:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788940780.989978:0:15161:0:(genops.c:893:class_export_put()) final put ffff91d039a47800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788940780.989981:0:15161:0:(genops.c:852:class_export_destroy()) destroying export ffff91d039a47800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788940780.989986:0:15161:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788940780.990078:0:15161:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91d020ffd800 00000020:02000400:1.0:1788940780.990130:0:15161:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788940782.053727:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940783.084105:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940783.260186:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944940032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940783.260275:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940783.265151:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944940032 00000100:00100000:2.0:1788940783.265166:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944940032 00000100:00100000:2.0:1788940783.265227:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788940783.265238:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944940032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788940783.265288:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788940783.265387:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944940032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 151us (5130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940783.265394:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788940783.265471:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944940032:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788940783.266043:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788940784.096520:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940784.284383:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1788940784.719939:0:15363:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788940784.728613:0:15363:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788940784.728666:0:15363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053000/0x9c34acc08badd194 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd19b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.728681:0:15363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053000/0x9c34acc08badd194 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd19b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.728690:0:15363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053000/0x9c34acc08badd194 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd19b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.728698:0:15363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d042053000/0x9c34acc08badd194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd19b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.728726:0:15363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788940784.728731:0:15363:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788940784.728756:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788940784.728760:0:15363:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788940784.728766:0:15363:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788940784.728772:0:15363:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d3000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788940784.728777:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788940784.728779:0:15363:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788940784.728782:0:15363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788940784.729680:0:15363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0027f6600/0x9c34acc08badd1a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd1a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.729694:0:15363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0027f6600/0x9c34acc08badd1a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd1a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.729701:0:15363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0027f6600/0x9c34acc08badd1a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd1a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.729724:0:15363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d0027f6600/0x9c34acc08badd1a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd1a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.729742:0:15363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788940784.729754:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940784.729759:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d042053000/0x9c34acc08badd194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd19b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.729766:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042053000 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788940784.729769:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d042053000/0x9c34acc08badd194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd19b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.729778:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d042053000/0x9c34acc08badd194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08badd19b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940784.729785:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d042053000/0x9c34acc08badd194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08badd19b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940784.729790:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788940784.729793:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788940784.729795:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788940784.729827:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d042053000/0x9c34acc08badd194 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd19b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.729833:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940784.729854:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d042053000/0x9c34acc08badd194 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd19b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.729861:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d042053000/0x9c34acc08badd194 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd19b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.729879:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940784.729882:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0027f6600/0x9c34acc08badd1a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd1a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.729887:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6600 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788940784.729890:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0027f6600/0x9c34acc08badd1a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd1a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.729896:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0027f6600/0x9c34acc08badd1a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08badd1a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940784.729903:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0027f6600/0x9c34acc08badd1a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08badd1a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940784.729908:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788940784.729910:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1788940784.729922:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0027f6600/0x9c34acc08badd1a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd1a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.729927:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940784.729941:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0027f6600/0x9c34acc08badd1a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd1a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.729948:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0027f6600/0x9c34acc08badd1a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd1a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940784.729956:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940784.729957:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940784.729959:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940784.729981:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944940160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940784.729981:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944940288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940784.730052:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940784.730318:0:15363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badd07c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd083 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.730342:0:15363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badd07c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd083 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.730350:0:15363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badd07c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd083 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.730356:0:15363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badd07c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd083 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.730371:0:15363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940784.730377:0:15363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e7800/0x9c34acc08badd418 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd41f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.730379:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940784.730384:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badd07c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd083 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.730385:0:15363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e7800/0x9c34acc08badd418 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd41f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.730392:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584da00 already unused, calling callback (ffffffffc12d7c20) 00010000:00010000:1.0:1788940784.730392:0:15363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e7800/0x9c34acc08badd418 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd41f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940784.730401:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badd07c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd083 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.730405:0:15363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d0355e7800/0x9c34acc08badd418 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd41f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.730408:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badd07c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08badd083 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940784.730415:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badd07c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08badd083 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.730415:0:15363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940784.730420:0:15363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0027f6800/0x9c34acc08badcd65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badcd6c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940784.730421:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788940784.730423:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788940784.730425:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788940784.730427:0:15363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0027f6800/0x9c34acc08badcd65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badcd6c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.730432:0:15363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0027f6800/0x9c34acc08badcd65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badcd6c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.730439:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badd07c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd083 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940784.730439:0:15363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d0027f6800/0x9c34acc08badcd65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badcd6c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.730446:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940784.730450:0:15363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788940784.730452:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badd07c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd083 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940784.730452:0:15363:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1788940784.730455:0:15363:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:2.0:1788940784.730458:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badd07c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd083 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.730471:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940784.730474:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0355e7800/0x9c34acc08badd418 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd41f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.730479:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7800 already unused, calling callback (ffffffffc12d7c20) 00000020:01000004:1.0:1788940784.730481:0:15363:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 10000000:00010000:2.0:1788940784.730482:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e7800/0x9c34acc08badd418 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd41f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1788940784.730484:0:15363:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00010000:00010000:2.0:1788940784.730488:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0355e7800/0x9c34acc08badd418 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08badd41f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788940784.730489:0:15363:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940784.730494:0:15363:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 10000000:00010000:2.0:1788940784.730499:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e7800/0x9c34acc08badd418 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08badd41f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788940784.730499:0:15363:0:(genops.c:1827:print_export_data()) lustre-MDT0001: ACTIVE ffff91cf079fd000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788940784.730504:0:15363:0:(genops.c:1827:print_export_data()) lustre-MDT0001: ACTIVE ffff91cf060e7800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:2.0:1788940784.730505:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788940784.730508:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788940784.730509:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:1.0:1788940784.730510:0:15363:0:(genops.c:1561:class_disconnect_exports()) OBD device 11 (ffff91d0050e19d8) has exports, disconnecting them 00000020:00080000:1.0:1788940784.730513:0:15363:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff91cf079fd000), last request at 1788940780 00010000:00010000:2.0:1788940784.730520:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0355e7800/0x9c34acc08badd418 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd41f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788940784.730520:0:15363:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd044 00010000:00010000:2.0:1788940784.730524:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940784.730533:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0355e7800/0x9c34acc08badd418 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd41f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788940784.730537:0:15363:0:(import.c:65:import_set_state_nolock()) ffff91cf079fd800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788940784.730540:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0355e7800/0x9c34acc08badd418 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badd41f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.730547:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940784.730550:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0027f6800/0x9c34acc08badcd65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badcd6c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.730556:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6800 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940784.730558:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0027f6800/0x9c34acc08badcd65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badcd6c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.730565:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0027f6800/0x9c34acc08badcd65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08badcd6c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788940784.730570:0:15363:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91cf079fd000): rc 0 10000000:00010000:2.0:1788940784.730571:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0027f6800/0x9c34acc08badcd65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08badcd6c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788940784.730573:0:15363:0:(genops.c:893:class_export_put()) final put ffff91cf079fd000/lustre-MDT0001-lwp-OST0001_UUID 10000000:01000000:2.0:1788940784.730584:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788940784.730586:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00000020:00080000:1.0:1788940784.730586:0:15363:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff91cf060e7800), last request at 1788940780 10000000:01000000:2.0:1788940784.730588:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00000080:1.0:1788940784.730589:0:15363:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcf1e 00000100:00080000:1.0:1788940784.730593:0:15363:0:(import.c:65:import_set_state_nolock()) ffff91cf060e4000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788940784.730599:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0027f6800/0x9c34acc08badcd65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badcd6c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788940784.730599:0:15363:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91cf060e7800): rc 0 00000020:00000080:1.0:1788940784.730601:0:15363:0:(genops.c:893:class_export_put()) final put ffff91cf060e7800/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:2.0:1788940784.730604:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940784.730610:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0027f6800/0x9c34acc08badcd65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badcd6c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:1.0:1788940784.730610:0:15363:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff9d5841c77ae0 00010000:00010000:2.0:1788940784.730616:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0027f6800/0x9c34acc08badcd65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08badcd6c expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940784.730626:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788940784.730626:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1788940784.730627:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940784.730629:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940784.730629:0:15363:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1788940784.730638:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944940544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940784.730742:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940784.730791:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940784.730797:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944940416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940784.730818:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940784.730846:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944940288 00000100:00100000:0.0:1788940784.730852:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944940288 00000100:00100000:0.0:1788940784.730880:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944940416 00000100:00100000:0.0:1788940784.730882:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944940416 00000100:00100000:0.0:1788940784.730898:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788940784.730904:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d003fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1875839944940288:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788940784.730911:0:6506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788940784 with bad export cookie 11255811311682833506 00000100:00080000:1.0:1788940784.731676:0:15363:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788940784.731683:0:15363:0:(import.c:65:import_set_state_nolock()) ffff91d004280000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:1.0:1788940784.731718:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940784.731739:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788940784.731746:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1875839944940416:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788940784.731751:0:7474:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788940784 with bad export cookie 11255811311682833506 00000100:00100000:1.0:1788940784.731806:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1875839944940416:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (986us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788940784.731813:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788940784.731856:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.125@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788940784.731861:0:3645:0:(import.c:65:import_set_state_nolock()) ffff91d03ece2800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788940784.731865:0:3645:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1788940784.732038:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940784.734632:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940784.734688:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944940160 00000100:00100000:2.0:1788940784.734696:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944940160 00000100:00100000:2.0:1788940784.734723:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944940544 00000100:00100000:2.0:1788940784.734726:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944940544 00000100:00100000:2.0:1788940784.734737:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788940784.734744:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3648:x1875839944940160:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788940784.734750:0:6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788940784 with bad export cookie 11255811311682833506 00000100:00100000:2.0:1788940784.734791:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3648:x1875839944940160:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (2753us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788940784.734798:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788940784.734827:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788940784.734831:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3647:x1875839944940544:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788940784.734835:0:6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788940784 with bad export cookie 11255811311682833506 00000100:00100000:2.0:1788940784.734868:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3647:x1875839944940544:12345-0@lo:103:ldlm_bl.0 Request processed in 36us (242us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788940784.734874:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:2.0:1788940784.734893:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788940784.734912:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.125@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788940784.740496:0:3645:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.125@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788940784.740503:0:3645:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788940784.740513:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91cf07fd8700 x1875839944940288/t0(0) o103->MGC192.168.202.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788940800 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940784.740551:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91cf08c0d500 x1875839944940160/t0(0) o103->MGC192.168.202.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788940800 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940784.740562:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d018b09f80 x1875839944940544/t0(0) o103->MGC192.168.202.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788940800 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940784.740572:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d018b09c00 x1875839944940416/t0(0) o103->MGC192.168.202.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788940800 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788940784.740629:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788940784.740633:0:3647:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff91d03ece2800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:1.0:1788940784.740633:0:3645:0:(pinger.c:194:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788940784.740634:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788940784.740638:0:3645:0:(import.c:65:import_set_state_nolock()) ffff91d03ece2800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940784.740641:0:3645:0:(import.c:545:import_select_connection()) MGC192.168.202.125@tcp: connect to NID 0@lo last attempt 222 00000100:00080000:1.0:1788940784.740650:0:3645:0:(import.c:665:import_select_connection()) MGC192.168.202.125@tcp: import ffff91d03ece2800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788940784.740653:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf4e294e-c65c-4988-a227-6e2e705a91d9:3647:1875839944940544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940784.740680:0:3645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf079e8380 x1875839944940800/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940784.740706:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf4e294e-c65c-4988-a227-6e2e705a91d9:3644:1875839944940800:0@lo:250:ptlrpcd_00_00.0 00000100:00100000:1.0:1788940784.740711:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944940288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940784.740723:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf4e294e-c65c-4988-a227-6e2e705a91d9:3645:1875839944940416:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1788940784.740750:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875839944940800 offset 0 length 520: 4 00000100:00100000:3.0:1788940784.740999:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:0:1875839944940672:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788940784.741035:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf079fd000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788940784.741094:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf060e7800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788940784.741127:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf079fd800 for lustre-MDT0001 00000020:00000080:3.0:1788940784.741133:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf060e4000 for lustre-MDT0001 00000100:00100000:2.0:1788940784.741313:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf4e294e-c65c-4988-a227-6e2e705a91d9:3648:1875839944940160:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788940784.742077:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788940784.742081:0:15363:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1788940784.742096:0:15363:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788940784.742168:0:15363:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788940784.742189:0:15363:0:(import.c:65:import_set_state_nolock()) ffff91d03ec10000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788940784.742200:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788940784.742202:0:15363:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1788940784.742209:0:15363:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788940784.742288:0:15363:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788940784.742298:0:15363:0:(import.c:65:import_set_state_nolock()) ffff91d02ebf6800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788940784.742343:0:15363:0:(genops.c:1566:class_disconnect_exports()) OBD device 11 (ffff91d0050e19d8) has no exports 00000100:00100000:2.0:1788940784.742952:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944940928:0@lo:9:umount.0 00000100:00100000:2.0:1788940784.743004:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940784.743036:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944941056:0@lo:9:umount.0 00000100:00100000:1.0:1788940784.743044:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944940928 00000100:00100000:1.0:1788940784.743052:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944940928 00000100:00100000:2.0:1788940784.743055:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940784.743116:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944941056 00000100:00100000:1.0:1788940784.743120:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944941056 00000100:00100000:1.0:1788940784.743149:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788940784.743157:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875839944940928:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788940784.743180:0:8437:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcf6b 00000100:00080000:1.0:1788940784.743189:0:8437:0:(import.c:65:import_set_state_nolock()) ffff91cf01fde800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788940784.743219:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788940784.743227:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788940784.743399:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3644:x1875839944940928:12345-0@lo:9:umount.0 Request processed in 241us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940784.743407:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788940784.743422:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788940784.743429:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875839944941056:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788940784.743441:0:8437:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd0ad 00000100:00080000:1.0:1788940784.743446:0:8437:0:(import.c:65:import_set_state_nolock()) ffff91d03ec17800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788940784.743467:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788940784.743542:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3644:x1875839944941056:12345-0@lo:9:umount.0 Request processed in 113us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940784.743548:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788940784.743569:0:6516:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788940784.743581:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788940784.743954:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03ec10000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788940784.743966:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788940784.743969:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788940784.743973:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944940928:0@lo:9:umount.0 00000100:00080000:2.0:1788940784.743985:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02ebf6800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788940784.743994:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788940784.743996:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788940784.744011:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944941056:0@lo:9:umount.0 00000400:00000100:0.0:1788940784.745079:0:6506:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875839944940288 offset 224 length 224: 4 00000100:00100000:0.0:1788940784.745092:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d003fe6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1875839944940288:12345-0@lo:103:ldlm_bl.0 Request processed in 14188us (14351us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788940784.745100:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:00080000:2.0:1788940784.756419:0:15363:0:(genops.c:1566:class_disconnect_exports()) OBD device 11 (ffff91d0050e19d8) has no exports 00000020:01000000:0.0:1788940784.795663:0:15363:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d004e8e580 - data ffff91d04123f5e8/ffff91cf07fae800 00000020:01000000:0.0:1788940784.795786:0:15363:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d040fe3c00 - data ffff91d0411731b0/ffff91d02eb1f400 00000001:00000004:0.0:1788940784.809385:0:15363:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1788940784.875369:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788940784.875379:0:15363:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788940784.875387:0:15363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788940784.878044:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788940784.878113:0:15363:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1788940784.878376:0:15363:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788940784.878380:0:15363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788940784.885491:0:8514:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788940784.885499:0:8514:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1788940784.885532:0:8514:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788940784.887297:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788940784.887304:0:15363:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1788940784.887320:0:15363:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788940784.887323:0:15363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788940784.888070:0:9789:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788940784.888076:0:9789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1788940784.888086:0:9789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788940784.897370:0:15363:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcd88 00000020:00000080:3.0:1788940784.897383:0:15363:0:(genops.c:893:class_export_put()) final put ffff91d004284000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788940784.898110:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d004284000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788940784.900974:0:15363:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcd9d 00000020:00000080:3.0:1788940784.900988:0:15363:0:(genops.c:893:class_export_put()) final put ffff91d02ebf0000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788940784.901109:0:15363:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788940784.901115:0:15363:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940784.901123:0:15363:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788940784.901126:0:15363:0:(genops.c:1566:class_disconnect_exports()) OBD device 10 (ffff91d0050e33b0) has no exports 00000004:01000000:3.0:1788940784.901344:0:15363:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788940784.901353:0:15363:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd0a6 00000020:00000080:3.0:1788940784.901357:0:15363:0:(genops.c:893:class_export_put()) final put ffff91cf079fb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788940784.902078:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02ebf0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788940784.902182:0:15363:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788940784.902189:0:15363:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940784.902199:0:15363:0:(obd_config.c:1048:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788940784.902202:0:15363:0:(genops.c:1566:class_disconnect_exports()) OBD device 27 (ffff91cf06cd99d8) has no exports 00000020:00000080:3.0:1788940784.902220:0:15363:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd09f 00000020:00000080:3.0:1788940784.902225:0:15363:0:(genops.c:893:class_export_put()) final put ffff91d02ebf0800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788940784.903027:0:15363:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788940784.903032:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788940784.903037:0:15363:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1788940784.903043:0:15363:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788940784.903045:0:15363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788940784.903084:0:15363:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940784.903094:0:15363:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788940784.903101:0:15363:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcf64 00000020:00000080:3.0:1788940784.903106:0:15363:0:(genops.c:893:class_export_put()) final put ffff91cf01fda000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788940784.903110:0:15363:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788940784.903114:0:15363:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940784.903118:0:15363:0:(obd_config.c:1048:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788940784.903121:0:15363:0:(genops.c:1566:class_disconnect_exports()) OBD device 21 (ffff91cf06cdb3b0) has no exports 00000020:00000080:3.0:1788940784.903125:0:15363:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcf5d 00000020:00000080:3.0:1788940784.903128:0:15363:0:(genops.c:893:class_export_put()) final put ffff91d03ec12000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788940784.904102:0:15363:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788940784.904108:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788940784.904111:0:15363:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1788940784.904115:0:15363:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788940784.904117:0:15363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788940784.904190:0:15363:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940784.904198:0:15363:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788940784.904212:0:15363:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788940784.904217:0:15363:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcdc0 00000020:00000080:3.0:1788940784.904223:0:15363:0:(genops.c:893:class_export_put()) final put ffff91d004634800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788940784.904504:0:15363:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788940784.904509:0:15363:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940784.904514:0:15363:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788940784.904517:0:15363:0:(genops.c:1566:class_disconnect_exports()) OBD device 13 (ffff91d03ec5b3b0) has no exports 00000020:00000080:3.0:1788940784.904533:0:15363:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcdb9 00000020:00000080:3.0:1788940784.904546:0:15363:0:(genops.c:893:class_export_put()) final put ffff91d030202800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788940784.907454:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf079fb000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788940784.907469:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02ebf0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788940784.907477:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d02ebf6800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788940784.907485:0:37:0:(genops.c:893:class_export_put()) final put ffff91cf079f8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788940784.907488:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf079f8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788940784.907492:0:37:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788940784.907596:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf01fda000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788940784.907602:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03ec12000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788940784.907606:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d03ec10000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788940784.907611:0:37:0:(genops.c:893:class_export_put()) final put ffff91d034755800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788940784.907613:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d034755800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788940784.907617:0:37:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788940784.907657:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d004634800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788940784.907662:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d030202800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788940784.908347:0:15363:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788940784.908352:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788940784.908357:0:15363:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788940784.908364:0:15363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788940784.908437:0:15363:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940784.908449:0:15363:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788940784.908473:0:15363:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940784.908476:0:15363:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788940784.908480:0:15363:0:(genops.c:893:class_export_put()) final put ffff91d02e8d2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788940784.908483:0:15363:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02e8d2800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788940784.908492:0:15363:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788940784.908637:0:15363:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcda4 00000020:00000080:0.0:1788940784.908645:0:15363:0:(genops.c:893:class_export_put()) final put ffff91d02ebf1000/lustre-MDD0001_UUID 00000020:01000000:0.0:1788940784.908651:0:15363:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788940784.908655:0:15363:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940784.908660:0:15363:0:(obd_config.c:1048:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788940784.908664:0:15363:0:(genops.c:1566:class_disconnect_exports()) OBD device 12 (ffff91d0050e0000) has no exports 00000020:00000080:0.0:1788940784.908693:0:15363:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940784.908697:0:15363:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788940784.908701:0:15363:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcdab 00000020:00000080:0.0:1788940784.908705:0:15363:0:(genops.c:893:class_export_put()) final put ffff91d02ebf1800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788940784.908718:0:15363:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d034739000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788940784.908722:0:15363:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d034739000 2 00000020:01000004:0.0:1788940784.908725:0:15363:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91d034739000 from lustre-MDT0001 00000020:00000080:0.0:1788940784.908741:0:15363:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940784.908745:0:15363:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788940784.908747:0:15363:0:(genops.c:893:class_export_put()) final put ffff91d004287800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788940784.908750:0:15363:0:(genops.c:852:class_export_destroy()) destroying export ffff91d004287800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788940784.908757:0:15363:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788940784.908788:0:15363:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788940784.908792:0:15363:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788940784.908795:0:15363:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940784.908798:0:15363:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788940784.908804:0:15363:0:(genops.c:1827:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff91d03566d000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788940784.908809:0:15363:0:(genops.c:1561:class_disconnect_exports()) OBD device 14 (ffff91d03560b3b0) has exports, disconnecting them 00000020:00080000:0.0:1788940784.908813:0:15363:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff91d03566d000), last request at 1788940490 00000020:00000080:0.0:1788940784.908817:0:15363:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcdff 00000020:00080000:0.0:1788940784.908829:0:15363:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d03566d000): rc 0 00000020:00000080:0.0:1788940784.908832:0:15363:0:(genops.c:893:class_export_put()) final put ffff91d03566d000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788940784.910048:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d004280000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788940784.910068:0:37:0:(genops.c:893:class_export_put()) final put ffff91d03547a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788940784.910071:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03547a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788940784.910080:0:37:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788940784.910189:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02ebf1000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788940784.910193:0:37:0:(genops.c:893:class_export_put()) final put ffff91d02e8d5800/lustre-MDD0001_UUID 00000020:00000080:1.0:1788940784.910195:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02e8d5800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788940784.910198:0:37:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788940784.910422:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02ebf1800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788940784.910427:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03566d000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788940784.910464:0:15363:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788940784.910468:0:15363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788940784.910472:0:15363:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788940784.910490:0:15363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788940784.910508:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d02e8d3000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788940784.910669:0:15363:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940784.910685:0:15363:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788940784.910688:0:15363:0:(genops.c:893:class_export_put()) final put ffff91d02ebf2800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788940784.910690:0:15363:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02ebf2800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788940784.910694:0:15363:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788940784.910724:0:15363:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d034739000 1 00000020:00000080:1.0:1788940784.910728:0:15363:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcd3b 00000020:00000080:1.0:1788940784.910733:0:15363:0:(genops.c:893:class_export_put()) final put ffff91d034754800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788940784.910741:0:15363:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788940784.910747:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d034754800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788940784.910755:0:15363:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940784.910759:0:15363:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788940784.910762:0:15363:0:(genops.c:1566:class_disconnect_exports()) OBD device 9 (ffff91d004640000) has no exports 00000020:00000080:0.0:1788940785.052725:0:15363:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940785.052738:0:15363:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788940785.052744:0:15363:0:(genops.c:893:class_export_put()) final put ffff91d03473b800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788940785.052748:0:15363:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03473b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788940785.052760:0:15363:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788940785.052883:0:15363:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91d03473e000 00000020:01000000:0.0:1788940785.052906:0:15363:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788940785.053026:0:15363:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940785.053031:0:15363:0:(obd_config.c:1048:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788940785.053035:0:15363:0:(genops.c:1566:class_disconnect_exports()) OBD device 3 (ffff91d0050999d8) has no exports 00000100:00100000:3.0:1788940785.053173:0:6521:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff91d0312a0e00:6521] 1 exiting: rc = 0 00000100:00100000:3.0:1788940785.053338:0:9713:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff91d02c309e00:9713] 4 exiting: rc = 0 00000100:00100000:1.0:1788940785.053562:0:6520:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff91d0200e9000:6520] 0 exiting: rc = 1 00000100:00100000:1.0:1788940785.053770:0:8517:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff91d035756200:8517] 3 exiting: rc = 0 00000100:00100000:2.0:1788940785.055833:0:6522:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff91d0312a0200:6522] 2 exiting: rc = 0 00000100:00100000:0.0:1788940785.056052:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056063:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056069:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056089:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056094:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056101:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056108:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056114:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056119:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056125:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056131:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056137:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056143:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056148:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056154:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056159:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056165:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056171:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056177:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056184:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056190:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056196:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056201:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056207:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056214:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056219:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056225:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056231:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056236:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056241:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056247:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056252:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056300:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056307:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056312:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056318:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056324:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056340:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056353:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056358:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056365:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056371:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056376:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056381:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056386:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056391:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056396:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056402:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056408:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056414:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056420:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056426:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056433:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056439:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056445:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056451:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056456:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056461:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056466:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056472:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056478:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056483:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056487:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.056492:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940785.073907:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff91d0312a0600:6524] 1 exiting: rc = 0 00000100:00100000:3.0:1788940785.074157:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff91d0312a1800:6523] 0 exiting: rc = 1 00000100:00100000:0.0:1788940785.074290:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074299:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074306:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074312:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074319:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074324:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074342:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074348:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074355:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074376:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074382:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074388:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074395:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074399:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074405:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074410:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074416:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074421:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074426:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074431:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074436:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074442:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074448:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074453:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074459:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074464:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074469:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074475:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074480:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074486:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074493:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074498:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074503:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074508:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074513:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074519:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074536:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074542:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074547:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074552:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074557:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074562:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074568:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074574:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074587:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074592:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074597:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074602:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074608:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074613:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074618:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074623:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074627:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074632:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074648:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074654:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074659:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074664:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074669:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074674:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074679:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074684:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074688:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.074693:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.075400:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff91d006bf3e00:6526] 1 exiting: rc = 0 00000100:00100000:3.0:1788940785.075594:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff91d0312a1c00:6525] 0 exiting: rc = 1 00000100:00100000:2.0:1788940785.076058:0:7798:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff91d035753800:7798] 2 exiting: rc = 0 00000100:00100000:1.0:1788940785.076169:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076178:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076195:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076202:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076208:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076215:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076222:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076229:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076235:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076241:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076247:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076252:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076306:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076313:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076319:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076334:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076341:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076346:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076351:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076357:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076363:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076369:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076375:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076381:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076403:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076410:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076417:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076423:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076430:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076435:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076441:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076447:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076452:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076458:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076479:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076484:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076505:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076513:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076518:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076537:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076543:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076548:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076553:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076558:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076564:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076569:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076576:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076583:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076604:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076611:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076618:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076624:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076630:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076821:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076830:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076836:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076845:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076851:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076858:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076864:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076887:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076895:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076901:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.076907:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788940785.116748:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940785.117830:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff91d02c1a7400:6528] 1 exiting: rc = 0 00000100:00100000:2.0:1788940785.118027:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff91d0312a0000:6527] 0 exiting: rc = 1 00000100:00100000:0.0:1788940785.118293:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118301:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118306:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118312:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118319:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118334:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118340:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118346:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118351:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118357:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118362:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118367:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118371:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118376:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118396:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118401:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118407:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118412:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118416:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118421:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118426:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118431:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118436:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118442:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118447:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118452:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118458:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118463:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118468:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118473:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118478:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118484:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118489:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118494:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118500:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118506:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118511:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118528:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118535:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118541:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118546:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118551:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118557:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118562:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118568:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118573:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118579:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118583:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118588:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118601:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118606:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118611:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118617:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118622:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118628:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118730:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118739:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118745:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118750:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118754:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118759:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118763:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118768:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.118773:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119227:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff91d0100f1c00:6530] 1 exiting: rc = 0 00000100:00100000:2.0:1788940785.119369:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff91d03ed3bc00:6529] 0 exiting: rc = 1 00000100:00100000:0.0:1788940785.119449:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119455:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119460:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119465:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119470:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119475:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119480:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119485:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119490:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119496:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119501:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119506:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119511:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119516:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119583:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119590:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119594:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119599:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119603:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119618:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119624:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119628:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119633:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119703:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119710:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119716:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119721:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119726:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119732:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119736:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119742:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119746:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119750:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119755:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119761:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119767:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119772:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119778:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119783:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119788:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119794:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119799:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119804:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119809:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119813:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119819:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119825:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119829:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119834:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119839:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119844:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119849:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119855:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119859:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119873:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119878:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119882:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119888:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119893:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119897:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119902:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.119907:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.120383:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.120389:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940785.123456:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff91d021123200:6531] 0 exiting: rc = 1 00000100:00100000:2.0:1788940785.123702:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff91d021123400:6532] 1 exiting: rc = 0 00000100:00100000:0.0:1788940785.123901:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.123919:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.123926:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.123932:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.123937:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.123942:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.123948:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.123954:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.123961:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.123966:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.123972:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.123978:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.123983:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.123988:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.123994:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.123999:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124005:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124010:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124015:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124020:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124026:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124031:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124050:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124056:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124061:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124080:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124085:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124090:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124096:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124101:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124107:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124112:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124118:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124122:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124127:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124134:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124139:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124145:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124151:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124156:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124162:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124168:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124173:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124179:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124184:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124189:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124194:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124199:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124204:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124209:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124215:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124219:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124224:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124229:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124236:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124241:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124246:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124250:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124281:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124289:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124301:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124306:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124311:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940785.124317:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.125791:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff91d006bdc400:6533] 0 exiting: rc = 1 00000100:00100000:0.0:1788940785.128628:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff91d018b31800:6535] 2 exiting: rc = 0 00000100:00100000:3.0:1788940785.129466:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff91d006bdc600:6534] 1 exiting: rc = 0 00000100:00100000:1.0:1788940785.129587:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129595:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129601:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129606:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129625:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129630:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129647:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129653:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129660:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129665:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129671:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129676:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129682:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129688:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129694:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129700:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129727:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129734:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129740:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129745:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129750:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129755:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129760:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129765:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129772:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129778:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129783:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129788:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129794:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129799:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129804:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129810:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129816:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129821:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129827:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129832:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129838:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129844:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129849:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129862:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129881:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129887:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129893:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129898:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129903:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129918:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129926:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129931:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129936:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129941:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129947:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129952:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129957:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129962:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129968:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129974:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129979:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129985:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129990:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.129997:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.130002:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.130008:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.130013:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940785.130019:0:15363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788940785.145740:0:15363:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940785.145757:0:15363:0:(obd_config.c:958:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788940785.145764:0:15363:0:(genops.c:893:class_export_put()) final put ffff91d03ece6000/MDS_uuid 00000020:00000080:1.0:1788940785.145769:0:15363:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03ece6000/MDS_uuid for MDS 00000020:01000000:1.0:1788940785.145780:0:15363:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788940785.145976:0:15363:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00000100:00080000:3.0:1788940785.311397:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788940785.311405:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788940785.311409:0:37:0:(import.c:65:import_set_state_nolock()) ffff91cf060e3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940785.311418:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 535 00000100:00080000:3.0:1788940785.311424:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788940785.311431:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91cf060e3800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940785.311465:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d020c8c700 x1875839944941184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940785.311519:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875839944941184:0@lo:38:kworker.0 00000400:00000100:2.0:1788940785.311566:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839944941184 offset 0 length 520: 4 00000100:00080000:3.0:1788940785.311655:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788940785.311659:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788940785.311662:0:37:0:(import.c:65:import_set_state_nolock()) ffff91cf07a1e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940785.311666:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 535 00000100:00080000:3.0:1788940785.311669:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788940785.311673:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91cf07a1e800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940785.311685:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d020c8ea00 x1875839944941440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940785.311733:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944941312:0@lo:400:kworker.0 00000400:00000100:0.0:1788940785.311757:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839944941312 offset 0 length 224: 4 00000100:00100000:2.0:1788940785.315306:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875839944941440:0@lo:38:kworker.0 00000400:00000100:2.0:1788940785.315373:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839944941440 offset 0 length 520: 4 00000100:00100000:0.0:1788940785.315591:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944941568:0@lo:400:kworker.0 00000400:00000100:0.0:1788940785.315614:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839944941568 offset 0 length 224: 4 00010000:00010000:2.0:1788940786.139419:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940787.167392:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940788.191669:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788940789.044907:0:15564:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788940789.053378:0:15564:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788940789.053431:0:15564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badd178 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd17f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940789.053460:0:15564:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badd178 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd17f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940789.053468:0:15564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badd178 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd17f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940789.053474:0:15564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badd178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd17f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940789.053495:0:15564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788940789.053501:0:15564:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788940789.053528:0:15564:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788940789.053540:0:15564:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d020c8c700 x1875839944941184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788940805 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940789.053554:0:15564:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788940789.053560:0:15564:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788940789.053566:0:15564:0:(import.c:65:import_set_state_nolock()) ffff91cf060e3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788940789.053570:0:15564:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788940789.053574:0:15564:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d020c8c700 x1875839944941184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788940805 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940789.053581:0:15564:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788940789.053584:0:15564:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00010000:00010000:2.0:1788940789.054827:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940789.054839:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badd178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd17f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940789.054847:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaabc00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940789.054851:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badd178 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd17f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940789.054862:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badd178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08badd17f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940789.054870:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badd178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08badd17f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940789.054890:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788940789.054892:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788940789.054895:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788940789.054909:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d03ece2800 00010000:00010000:2.0:1788940789.054913:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badd178 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08badd17f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940789.054919:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02eaabc00/0x9c34acc08badd178 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08badd17f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940789.054932:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940789.054934:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940789.054935:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940789.054969:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875839944941184:0@lo:38:kworker.0 00000100:00080000:1.0:1788940789.056650:0:15564:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788940789.056668:0:15564:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d020c8ed80 x1875839944941312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940801 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940789.056711:0:15564:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788940789.056718:0:15564:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788940789.056742:0:15564:0:(import.c:65:import_set_state_nolock()) ffff91d02ebf3800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788940789.056812:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875839944941696:0@lo:39:umount.0 00000400:00000100:2.0:1788940789.056869:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839944941696 offset 0 length 224: 4 00000100:00100000:0.0:1788940789.057050:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944941312:0@lo:400:kworker.0 00010000:00010000:1.0:1788940789.211579:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940790.235456:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788940790.427470:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) bf4e294e-c65c-4988-a227-6e2e705a91d9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788940790.427482:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) bf4e294e-c65c-4988-a227-6e2e705a91d9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788940790.427485:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788940790.427488:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788940790.427694:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940790.427716:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944941824:0@lo:400:kworker.0 00000400:00000100:3.0:1788940790.427780:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839944941824 offset 0 length 224: 4 00000001:00100000:0.0:1788940790.433144:0:8432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788940790.433153:0:8432:0:(genops.c:893:class_export_put()) final put ffff91cf01fd8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788940790.433239:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf01fd8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000001:00100000:3.0:1788940790.433585:0:9517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788940790.433590:0:9517:0:(genops.c:893:class_export_put()) final put ffff91d03ec14000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788940790.433656:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf01fde800 for lustre-OST0000 00000020:00000080:2.0:1788940790.433763:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03ec14000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788940790.433959:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d03ec17800 for lustre-OST0001 00010000:00010000:2.0:1788940791.259540:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940792.283626:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940793.308243:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940794.204201:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940784/real 1788940784] req@ffff91cf079e8380 x1875839944940800/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788940794 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940794.204302:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91cf079e8380 x1875839944940800/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788940794 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788940794.204324:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03ece2800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788940794.204349:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788940794.204353:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf4e294e-c65c-4988-a227-6e2e705a91d9:3644:1875839944940800:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1788940794.204445:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) bf4e294e-c65c-4988-a227-6e2e705a91d9->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788940794.204449:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788940794.204452:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d03ece2800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940794.204456:0:8:0:(import.c:545:import_select_connection()) MGC192.168.202.125@tcp: connect to NID 0@lo last attempt 540 00000100:00080000:3.0:1788940794.204462:0:8:0:(import.c:630:import_select_connection()) MGC192.168.202.125@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788940794.204468:0:8:0:(import.c:665:import_select_connection()) MGC192.168.202.125@tcp: import ffff91d03ece2800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940794.204500:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d020c8fb80 x1875839944941952/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788940794.204524:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788940794.204529:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788940794.204636:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944942080:0@lo:400:kworker.0 00000400:00000100:0.0:1788940794.204698:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839944942080 offset 0 length 224: 4 00000100:00100000:2.0:1788940794.205110:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf4e294e-c65c-4988-a227-6e2e705a91d9:3644:1875839944941952:0@lo:250:kworker.0 00000400:00000100:2.0:1788940794.205133:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875839944941952 offset 0 length 520: 4 00010000:00010000:2.0:1788940794.331447:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940795.356528:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940796.380254:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940797.403513:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940798.427817:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940799.323474:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940789/real 1788940789] req@ffff91cf079e9180 x1875839944941696/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788940799 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940799.323502:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91cf079e9180 x1875839944941696/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788940799 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788940799.323518:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02ebf3800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788940799.323533:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875839944941696:0@lo:39:umount.0 00000100:00080000:1.0:1788940799.323572:0:15564:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788940799.323577:0:15564:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788940799.323581:0:15564:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788940799.325153:0:15564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08badd186 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd18d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.325173:0:15564:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08badd186 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd18d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.325181:0:15564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08badd186 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd18d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.325188:0:15564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08badd186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd18d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.325228:0:15564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940799.325236:0:15564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badd403 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.325242:0:15564:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badd403 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.325296:0:15564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badd403 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.325302:0:15564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badd403 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.325320:0:15564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788940799.325325:0:15564:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788940799.325350:0:15564:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788940799.325354:0:15564:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788940799.325359:0:15564:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940799.325364:0:15564:0:(obd_config.c:1048:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788940799.325368:0:15564:0:(genops.c:1566:class_disconnect_exports()) OBD device 18 (ffff91d0046433b0) has no exports 00000020:00080000:1.0:1788940799.325389:0:15564:0:(genops.c:1566:class_disconnect_exports()) OBD device 18 (ffff91d0046433b0) has no exports 00010000:00010000:2.0:1788940799.325893:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940799.325901:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08badd186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd18d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.325910:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042053200 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940799.325914:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08badd186 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd18d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.325947:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08badd186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08badd18d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940799.325955:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08badd186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08badd18d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940799.325961:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788940799.325963:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788940799.325965:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788940799.325979:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d03ece2800 00010000:00010000:2.0:1788940799.325982:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08badd186 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08badd18d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.325991:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08badd186 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08badd18d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.326003:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940799.326006:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badd403 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.326012:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584d800 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940799.326015:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badd403 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.326021:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badd403 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08badd40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940799.326026:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badd403 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08badd40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940799.326065:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788940799.326068:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788940799.326070:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788940799.326076:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d03ece2800 00010000:00010000:2.0:1788940799.326078:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badd403 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08badd40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.326084:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badd403 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08badd40a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.326093:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940799.326095:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940799.326097:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940799.326138:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788940799.328451:0:15564:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d035a02b00 - data ffff91cf06440e58/ffff91d02e9c8800 00000020:01000000:1.0:1788940799.328604:0:15564:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d020d00380 - data ffff91d04128f870/ffff91d037744800 00100000:10000000:1.0:1788940799.335794:0:15564:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788940799.360548:0:15564:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badced8 00000020:00000080:2.0:1788940799.360849:0:15564:0:(genops.c:893:class_export_put()) final put ffff91cf0612e000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788940799.360873:0:15564:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d035758800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788940799.360885:0:15564:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d035758800 2 00000020:01000004:2.0:1788940799.360889:0:15564:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91d035758800 from lustre-OST0000 00000020:00000080:2.0:1788940799.360917:0:15564:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940799.360927:0:15564:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788940799.360930:0:15564:0:(genops.c:893:class_export_put()) final put ffff91cf01ac3000/lustre-OST0000_UUID 00000020:00000080:2.0:1788940799.360933:0:15564:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf01ac3000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788940799.360940:0:15564:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788940799.361004:0:15564:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788940799.361009:0:15564:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788940799.361013:0:15564:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940799.361018:0:15564:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788940799.361025:0:15564:0:(genops.c:1827:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff91d02ebf7800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788940799.361031:0:15564:0:(genops.c:1561:class_disconnect_exports()) OBD device 19 (ffff91d0356099d8) has exports, disconnecting them 00000020:00080000:2.0:1788940799.361046:0:15564:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff91d02ebf7800), last request at 1788940515 00000020:00000080:2.0:1788940799.361050:0:15564:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcf02 00000020:00080000:2.0:1788940799.361060:0:15564:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d02ebf7800): rc 0 00000020:00000080:2.0:1788940799.361065:0:15564:0:(genops.c:893:class_export_put()) final put ffff91d02ebf7800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788940799.361224:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf0612e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788940799.361234:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02ebf7800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788940799.369350:0:15564:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788940799.369360:0:15564:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788940799.369364:0:15564:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788940799.369372:0:15564:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788940799.369578:0:15564:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940799.369589:0:15564:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788940799.369596:0:15564:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788940799.369604:0:15564:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940799.369608:0:15564:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788940799.369616:0:15564:0:(genops.c:1827:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff91d02ebf4000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788940799.369622:0:15564:0:(genops.c:1561:class_disconnect_exports()) OBD device 20 (ffff91cf06cdcd88) has exports, disconnecting them 00000020:00080000:3.0:1788940799.369626:0:15564:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff91d02ebf4000), last request at 1788940515 00000020:00000080:3.0:1788940799.369630:0:15564:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcf17 00000020:00080000:3.0:1788940799.369645:0:15564:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d02ebf4000): rc 0 00000020:00000080:3.0:1788940799.369663:0:15564:0:(genops.c:893:class_export_put()) final put ffff91d02ebf4000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788940799.370336:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf060e3800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788940799.370345:0:8:0:(genops.c:893:class_export_put()) final put ffff91cf060e2000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788940799.370348:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf060e2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788940799.370359:0:8:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788940799.370424:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02ebf4000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788940799.375398:0:15564:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788940799.375408:0:15564:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788940799.375424:0:15564:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788940799.375432:0:15564:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788940799.375464:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d02ebf3800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788940799.375664:0:15564:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940799.375673:0:15564:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1788940799.375678:0:15564:0:(genops.c:893:class_export_put()) final put ffff91d02ebf7000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1788940799.375682:0:15564:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02ebf7000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1788940799.375688:0:15564:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1788940799.375755:0:15564:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d035758800 1 00000020:00000080:0.0:1788940799.375761:0:15564:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcea0 00000020:00000080:0.0:1788940799.375767:0:15564:0:(genops.c:893:class_export_put()) final put ffff91d03575b000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788940799.375775:0:15564:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788940799.375783:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03575b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788940799.375791:0:15564:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940799.375796:0:15564:0:(obd_config.c:1048:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788940799.375799:0:15564:0:(genops.c:1566:class_disconnect_exports()) OBD device 16 (ffff91d035a8b3b0) has no exports 00000020:00000080:0.0:1788940799.421151:0:15564:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940799.421167:0:15564:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788940799.421172:0:15564:0:(genops.c:893:class_export_put()) final put ffff91d03575c800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788940799.421177:0:15564:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03575c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788940799.421190:0:15564:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788940799.421551:0:15564:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91d035759800 00000020:02000400:0.0:1788940799.421601:0:15564:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788940799.451662:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788940799.650049:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) bf4e294e-c65c-4988-a227-6e2e705a91d9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788940799.650060:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) bf4e294e-c65c-4988-a227-6e2e705a91d9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788940799.650063:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788940799.650066:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788940799.651089:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940799.651108:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944942208:0@lo:400:kworker.0 00000400:00000100:1.0:1788940799.651169:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839944942208 offset 0 length 224: 4 00010000:00010000:2.0:1788940800.478777:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940801.501523:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1788940801.691579:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940785/real 1788940785] req@ffff91d020c8d500 x1875839944941568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788940801 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940801.728391:0:3646:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff91d020c8d500 x1875839944941568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788940801 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788940801.728409:0:3646:0:(import.c:65:import_set_state_nolock()) ffff91cf01fdf000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788940801.728414:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788940801.747284:0:3646:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1788940801.747343:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) bf4e294e-c65c-4988-a227-6e2e705a91d9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788940801.747351:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) bf4e294e-c65c-4988-a227-6e2e705a91d9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788940801.747354:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788940801.747357:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788940801.747360:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788940801.747363:0:15176:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788940801.747367:0:15176:0:(import.c:65:import_set_state_nolock()) ffff91cf01fdf000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788940801.747380:0:15176:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 297 00000100:00080000:0.0:1788940801.747393:0:15176:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff91cf01fdf000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1788940801.747437:0:15176:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf07fda300 x1875839944942336/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940801.747797:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875839944942336:0@lo:38:kworker.0 00000400:00000100:3.0:1788940801.747857:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839944942336 offset 0 length 520: 4 00000100:00100000:3.0:1788940801.748308:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944941568:0@lo:400:kworker.0 00010000:00010000:0.0:1788940802.524670:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788940803.360250:0:15766:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788940803.378568:0:15766:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788940803.378678:0:15766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd15c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd163 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940803.378694:0:15766:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd15c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd163 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940803.378701:0:15766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd15c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd163 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940803.378709:0:15766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd15c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd163 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940803.378736:0:15766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788940803.378740:0:15766:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788940803.378766:0:15766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788940803.378779:0:15766:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d020c8ea00 x1875839944941440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788940805 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940803.378793:0:15766:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788940803.378799:0:15766:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788940803.378806:0:15766:0:(import.c:65:import_set_state_nolock()) ffff91cf07a1e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788940803.378811:0:15766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788940803.378815:0:15766:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d020c8ea00 x1875839944941440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788940805 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940803.378837:0:15766:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788940803.378840:0:15766:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00010000:00010000:0.0:1788940803.378945:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940803.378953:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd15c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd163 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940803.378962:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042052a00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788940803.378971:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd15c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd163 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940803.378980:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd15c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08badd163 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940803.378988:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd15c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08badd163 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940803.378995:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788940803.378997:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788940803.378999:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788940803.379011:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d03ece2800 00010000:00010000:0.0:1788940803.379015:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd15c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08badd163 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940803.379022:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d042052a00/0x9c34acc08badd15c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08badd163 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940803.379045:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940803.379047:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940803.379049:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940803.379331:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875839944941440:0@lo:38:kworker.0 00000100:00080000:2.0:1788940803.381242:0:15766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788940803.382130:0:15766:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d018b0b800 x1875839944941824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940806 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940803.382387:0:15766:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d020c8d180 x1875839944942080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940810 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940803.382398:0:15766:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91cf07fdb480 x1875839944942208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940815 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940803.382416:0:15766:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91cf07fda300 x1875839944942336/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788940811 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940803.382439:0:15766:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788940803.382895:0:15766:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788940803.382904:0:15766:0:(import.c:65:import_set_state_nolock()) ffff91cf01fdf000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788940803.382911:0:15766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788940803.382916:0:15766:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d018b0b800 x1875839944941824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940806 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940803.382988:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944942208:0@lo:400:kworker.0 00000100:00100000:0.0:1788940803.383075:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944941824:0@lo:400:kworker.0 00000100:00100000:2.0:1788940803.386556:0:15766:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d020c8d180 x1875839944942080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940810 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940803.386584:0:15766:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91cf07fdb480 x1875839944942208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940815 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940803.386595:0:15766:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91cf07fda300 x1875839944942336/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788940811 ref 1 fl Interpret:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940803.386604:0:15766:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788940803.387468:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875839944942336:0@lo:38:kworker.0 00000100:00100000:0.0:1788940803.387549:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944942080:0@lo:400:kworker.0 00000100:00100000:2.0:1788940803.387657:0:15766:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788940803.389167:0:15766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badd16a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd171 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940803.389198:0:15766:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badd16a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd171 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940803.389206:0:15766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badd16a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd171 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940803.389214:0:15766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badd16a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd171 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940803.389356:0:15766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940803.389364:0:15766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08badd3f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badd3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940803.389372:0:15766:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08badd3f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badd3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940803.389379:0:15766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08badd3f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940803.389385:0:15766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08badd3f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08badd3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940803.389515:0:10401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940803.389523:0:10401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badd16a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd171 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940803.389531:0:10401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02eaaa000 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788940803.389541:0:10401:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badd16a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd171 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940803.389550:0:10401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badd16a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08badd171 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940803.389558:0:10401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badd16a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08badd171 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940803.389565:0:10401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788940803.389567:0:10401:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788940803.389586:0:10401:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d03ece2800 00010000:00010000:0.0:1788940803.389590:0:10401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badd16a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08badd171 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940803.389597:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02eaaa000/0x9c34acc08badd16a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08badd171 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940803.389612:0:10401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940803.389616:0:10401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08badd3f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940803.389622:0:10401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603400 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788940803.389625:0:10401:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08badd3f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08badd3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940803.389632:0:10401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08badd3f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08badd3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940803.389638:0:10401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08badd3f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08badd3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940803.389654:0:10401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788940803.389656:0:10401:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788940803.389661:0:10401:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d03ece2800 00010000:00010000:0.0:1788940803.389664:0:10401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08badd3f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08badd3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940803.389672:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940803.389674:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940803.389676:0:10401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940803.389862:0:15766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788940803.389867:0:15766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08badd3f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08badd3fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940803.389884:0:15766:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788940803.389889:0:15766:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1788940803.389891:0:15766:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788940803.389927:0:15766:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788940803.389931:0:15766:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788940803.389936:0:15766:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940803.389942:0:15766:0:(obd_config.c:1048:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788940803.389945:0:15766:0:(genops.c:1566:class_disconnect_exports()) OBD device 24 (ffff91cf07a019d8) has no exports 00000020:00080000:2.0:1788940803.389968:0:15766:0:(genops.c:1566:class_disconnect_exports()) OBD device 24 (ffff91cf07a019d8) has no exports 00010000:00010000:0.0:1788940803.390142:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788940803.393414:0:15766:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d035a02080 - data ffff91d0413331b0/ffff91d02e9ca000 00000020:01000000:2.0:1788940803.393640:0:15766:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d035bae080 - data ffff91cf06442288/ffff91d0357e6400 00100000:10000000:1.0:1788940803.408005:0:15766:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788940803.422299:0:15766:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcffe 00000020:00000080:2.0:1788940803.422314:0:15766:0:(genops.c:893:class_export_put()) final put ffff91cf07a1d000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788940803.422333:0:15766:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d037817800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788940803.422336:0:15766:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d037817800 2 00000020:01000004:2.0:1788940803.422340:0:15766:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91d037817800 from lustre-OST0001 00000020:00000080:2.0:1788940803.422365:0:15766:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940803.422377:0:15766:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788940803.422381:0:15766:0:(genops.c:893:class_export_put()) final put ffff91d037776000/lustre-OST0001_UUID 00000020:00000080:2.0:1788940803.422384:0:15766:0:(genops.c:852:class_export_destroy()) destroying export ffff91d037776000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788940803.422390:0:15766:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788940803.422847:0:15766:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import bf4e294e-c65c-4988-a227-6e2e705a91d9->MGS 00010000:00010000:2.0:1788940803.422867:0:15766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0027f7800/0x9c34acc08badcd57 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08badcd5e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940803.422881:0:15766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0027f7800/0x9c34acc08badcd57 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08badcd5e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940803.422888:0:15766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788940803.422891:0:15766:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788940803.422894:0:15766:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788940803.422907:0:15766:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d03ece2800 00010000:00010000:2.0:1788940803.422911:0:15766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0027f7800/0x9c34acc08badcd57 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08badcd5e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940803.422945:0:15766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0355e6600/0x9c34acc08badd1cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08badd1d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940803.422953:0:15766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e6600/0x9c34acc08badd1cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08badd1d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940803.422958:0:15766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788940803.422960:0:15766:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788940803.422962:0:15766:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788940803.422972:0:15766:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d03ece2800 00010000:00010000:2.0:1788940803.422975:0:15766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0355e6600/0x9c34acc08badd1cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08badd1d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788940803.422991:0:15766:0:(import.c:65:import_set_state_nolock()) ffff91d03ece2800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788940803.422995:0:15766:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788940803.422997:0:15766:0:(pinger.c:194:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788940803.422999:0:15766:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788940803.423003:0:15766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788940803.423013:0:15766:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d020c8fb80 x1875839944941952/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788940809 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788940803.423091:0:15766:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788940803.423094:0:15766:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000020:00000080:3.0:1788940803.423166:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf07a1d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1788940803.423233:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf4e294e-c65c-4988-a227-6e2e705a91d9:3644:1875839944941952:0@lo:250:kworker.0 10000000:01000000:2.0:1788940803.423355:0:15766:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788940803.423363:0:15766:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcc54 00000020:00000080:2.0:1788940803.423368:0:15766:0:(genops.c:893:class_export_put()) final put ffff91d03ece3800/bf4e294e-c65c-4988-a227-6e2e705a91d9 00000020:01000000:2.0:1788940803.423410:0:15766:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of MGC192.168.202.125@tcp (flags='') 00000020:00000080:2.0:1788940803.423416:0:15766:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940803.423423:0:15766:0:(obd_config.c:1048:class_cleanup()) MGC192.168.202.125@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788940803.423428:0:15766:0:(genops.c:1566:class_disconnect_exports()) OBD device 2 (ffff91d00509b3b0) has no exports 10000000:01000000:1.0:1788940803.423475:0:6517:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788940803.423551:0:15766:0:(obd_class.h:676:obd_cleanup_client_import()) MGC192.168.202.125@tcp: client import never connected 00000100:00080000:2.0:1788940803.423560:0:15766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788940803.423562:0:15766:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788940803.423564:0:15766:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788940803.423566:0:15766:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788940803.426688:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03ece3800/bf4e294e-c65c-4988-a227-6e2e705a91d9 for MGC192.168.202.125@tcp 00000020:00000080:2.0:1788940803.427235:0:15766:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940803.427248:0:15766:0:(obd_config.c:958:class_detach()) detach on obd MGC192.168.202.125@tcp (uuid bf4e294e-c65c-4988-a227-6e2e705a91d9) 00000020:01000000:2.0:1788940803.427277:0:15766:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788940803.427288:0:15766:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940803.427294:0:15766:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788940803.427304:0:15766:0:(genops.c:1827:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff91cf07a1d800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788940803.427311:0:15766:0:(genops.c:1561:class_disconnect_exports()) OBD device 25 (ffff91cf07a00000) has exports, disconnecting them 00000020:00080000:2.0:1788940803.427318:0:15766:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff91cf07a1d800), last request at 1788940542 00000020:00000080:2.0:1788940803.427323:0:15766:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd028 00000020:00080000:2.0:1788940803.427341:0:15766:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91cf07a1d800): rc 0 00000020:00000080:2.0:1788940803.427346:0:15766:0:(genops.c:893:class_export_put()) final put ffff91cf07a1d800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788940803.429759:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d03ece2800 for MGC192.168.202.125@tcp 00000020:00000080:3.0:1788940803.429781:0:15176:0:(genops.c:893:class_export_put()) final put ffff91d03ece5000/bf4e294e-c65c-4988-a227-6e2e705a91d9 00000020:00000080:3.0:1788940803.429785:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03ece5000/bf4e294e-c65c-4988-a227-6e2e705a91d9 for MGC192.168.202.125@tcp 00000020:01000000:3.0:1788940803.429793:0:15176:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MGC192.168.202.125@tcp (bf4e294e-c65c-4988-a227-6e2e705a91d9) 00000020:00000080:3.0:1788940803.431327:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf07a1d800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788940803.432309:0:15766:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788940803.432315:0:15766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788940803.432319:0:15766:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788940803.432325:0:15766:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788940803.432499:0:15766:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940803.432508:0:15766:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1788940803.432514:0:15766:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788940803.432518:0:15766:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940803.432522:0:15766:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788940803.432528:0:15766:0:(genops.c:1827:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff91cf07a1a000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788940803.432534:0:15766:0:(genops.c:1561:class_disconnect_exports()) OBD device 26 (ffff91cf07a04d88) has exports, disconnecting them 00000020:00080000:3.0:1788940803.432538:0:15766:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff91cf07a1a000), last request at 1788940542 00000020:00000080:3.0:1788940803.432552:0:15766:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badd03d 00000020:00080000:3.0:1788940803.432566:0:15766:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91cf07a1a000): rc 0 00000020:00000080:3.0:1788940803.432572:0:15766:0:(genops.c:893:class_export_put()) final put ffff91cf07a1a000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788940803.433296:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf07a1e800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788940803.433306:0:15176:0:(genops.c:893:class_export_put()) final put ffff91cf07a19000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788940803.433317:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf07a19000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788940803.433324:0:15176:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788940803.433386:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf07a1a000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788940803.443350:0:15766:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788940803.443360:0:15766:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788940803.443365:0:15766:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788940803.443373:0:15766:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788940803.443468:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf01fdf000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788940803.448948:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788940803.449458:0:10401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788940803.449684:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788940803.449963:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff91d0033db000:6503] 0 exiting: rc = 1 00000100:00100000:1.0:1788940803.450110:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff91d0033dbc00:6504] 1 exiting: rc = 0 00000100:00100000:2.0:1788940803.450244:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.450945:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff91d0033db800:6505] 0 exiting: rc = 1 00000100:00100000:3.0:1788940803.451077:0:7474:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff91d035754600:7474] 3 exiting: rc = 0 00000100:00100000:2.0:1788940803.451249:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff91d02d3f2400:6507] 2 exiting: rc = 0 00000100:00100000:1.0:1788940803.451667:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff91d0050a3800:6506] 1 exiting: rc = 0 00000100:00100000:2.0:1788940803.451875:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.451891:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.451898:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.451903:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.451909:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.451914:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.451920:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.451926:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.451933:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.451939:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.451961:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.451966:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.451972:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.451978:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.451984:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.451990:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.451995:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.452002:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.452008:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.452016:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.452023:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.452095:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.452103:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.452108:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453279:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453291:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453298:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453302:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453307:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453312:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453317:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453323:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453328:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453335:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453341:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453346:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453351:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453356:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453361:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453366:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453371:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453376:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453381:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453386:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453391:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453408:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453413:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453419:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453424:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453430:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453435:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453439:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453445:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453450:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453455:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453461:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453466:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453471:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453476:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453481:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453486:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453493:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453498:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.453504:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788940803.454800:0:15766:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940803.454810:0:15766:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788940803.454816:0:15766:0:(genops.c:893:class_export_put()) final put ffff91cf07a18000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788940803.454819:0:15766:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf07a18000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788940803.454826:0:15766:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788940803.454882:0:15766:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d037817800 1 00000020:00000080:2.0:1788940803.454889:0:15766:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08badcfcd 00000020:00000080:2.0:1788940803.454895:0:15766:0:(genops.c:893:class_export_put()) final put ffff91cf060e1800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788940803.454910:0:15766:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788940803.454914:0:15766:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940803.454920:0:15766:0:(obd_config.c:1048:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788940803.454923:0:15766:0:(genops.c:1566:class_disconnect_exports()) OBD device 23 (ffff91d03560cd88) has no exports 00000020:00000080:1.0:1788940803.456677:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf060e1800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788940803.495101:0:15766:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940803.495115:0:15766:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788940803.495120:0:15766:0:(genops.c:893:class_export_put()) final put ffff91d037813000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788940803.495125:0:15766:0:(genops.c:852:class_export_destroy()) destroying export ffff91d037813000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788940803.495132:0:15766:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788940803.497037:0:15766:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91d037811800 00000020:01000000:3.0:1788940803.497065:0:15766:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788940803.497072:0:15766:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940803.497077:0:15766:0:(obd_config.c:1048:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788940803.497081:0:15766:0:(genops.c:1566:class_disconnect_exports()) OBD device 17 (ffff91d035a899d8) has no exports 00000020:00000080:3.0:1788940803.497102:0:15766:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940803.497110:0:15766:0:(obd_config.c:958:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788940803.497113:0:15766:0:(genops.c:893:class_export_put()) final put ffff91d0355c6800/OSS_uuid 00000020:00000080:3.0:1788940803.497117:0:15766:0:(genops.c:852:class_export_destroy()) destroying export ffff91d0355c6800/OSS_uuid for OSS 00000020:01000000:3.0:1788940803.497122:0:15766:0:(genops.c:443:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788940803.497337:0:6516:0:(pinger.c:603:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788940803.502480:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff91d021122800:8438] 1 exiting: rc = 0 00000100:00100000:3.0:1788940803.502992:0:8524:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff91d03574d600:8524] 3 exiting: rc = 0 00000100:00100000:1.0:1788940803.508931:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff91d004639a00:8437] 0 exiting: rc = 1 00000100:00100000:2.0:1788940803.510696:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff91d035790600:8439] 2 exiting: rc = 0 00000100:00100000:0.0:1788940803.512506:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512521:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512527:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512534:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512540:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512546:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512551:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512556:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512561:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512566:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512572:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512577:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512582:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512587:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512592:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512599:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512618:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512623:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512628:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512634:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512639:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512651:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512658:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512664:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512669:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512674:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512679:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512685:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512691:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512696:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512702:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512707:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512713:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512718:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512727:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512734:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512739:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512744:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512749:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512754:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512759:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512764:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512770:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512775:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512780:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512784:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512789:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512794:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512799:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512804:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512809:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512824:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512830:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512835:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512840:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512845:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512850:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512855:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512859:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512864:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512869:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512875:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512880:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.512885:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940803.520067:0:9962:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff91d02e8fac00:9962] 2 exiting: rc = 0 00000100:00100000:1.0:1788940803.520192:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff91d035796600:8441] 1 exiting: rc = 0 00000100:00100000:0.0:1788940803.520303:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff91d02126f800:8440] 0 exiting: rc = 1 00000100:00100000:3.0:1788940803.520713:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520727:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520735:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520741:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520747:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520753:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520759:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520766:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520770:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520776:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520781:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520787:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520792:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520809:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520815:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520820:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520826:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520832:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520837:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520843:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520848:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520853:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520858:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520864:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520870:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520876:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520881:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520887:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520892:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520898:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520903:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520909:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520915:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520921:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520926:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520931:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520937:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520947:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520958:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520965:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520970:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520976:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520981:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520988:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.520996:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521002:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521008:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521013:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521024:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521030:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521036:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521042:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521048:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521054:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521059:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521065:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521070:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521076:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521081:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521086:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521090:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521096:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521102:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.521107:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940803.523544:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff91d00de2f200:8443] 1 exiting: rc = 0 00000100:00100000:3.0:1788940803.523836:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff91d02ea13400:8444] 2 exiting: rc = 0 00000100:00100000:2.0:1788940803.524586:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff91d0196f8600:8442] 0 exiting: rc = 1 00000100:00100000:3.0:1788940803.524710:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524718:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524724:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524730:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524735:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524748:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524775:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524782:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524791:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524796:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524800:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524806:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524810:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524816:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524822:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524827:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524831:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524836:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524854:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524859:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524864:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524869:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524875:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524880:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524886:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524892:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524897:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524903:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524908:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524913:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524933:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524940:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524944:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524949:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524955:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524960:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524965:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524970:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524975:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524980:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524985:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524990:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.524996:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525001:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525006:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525011:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525017:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525022:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525028:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525033:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525039:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525044:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525049:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525062:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525074:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525080:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525085:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525091:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525104:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525117:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525123:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525129:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525148:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.525164:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.530123:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff91d02ea12200:8445] 0 exiting: rc = 1 00000100:00100000:2.0:1788940803.530842:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff91d02ea13600:8446] 1 exiting: rc = 0 00000100:00100000:3.0:1788940803.530962:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.530969:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.530975:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.530980:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.530985:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.530991:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.530996:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531001:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531006:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531012:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531017:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531022:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531033:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531041:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531046:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531051:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531056:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531061:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531066:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531071:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531077:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531082:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531087:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531092:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531109:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531114:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531118:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531122:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531127:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531197:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531205:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531210:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531214:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531219:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531224:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531228:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531233:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531238:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531243:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531247:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531252:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531343:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531350:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531355:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531360:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531367:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531372:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531378:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531383:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531388:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531393:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531400:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531406:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531410:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531414:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531420:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531425:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531430:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531435:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531448:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531454:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531459:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531464:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.531470:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940803.532598:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff91d035757400:8447] 0 exiting: rc = 1 00000100:00100000:0.0:1788940803.532873:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff91d02c308600:8448] 1 exiting: rc = 0 00000100:00100000:3.0:1788940803.532966:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.532973:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.532979:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.532985:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533014:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533022:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533028:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533034:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533040:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533046:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533051:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533058:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533065:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533071:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533077:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533084:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533104:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533113:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533118:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533124:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533141:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533148:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533162:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533169:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533174:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533181:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533186:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533192:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533211:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533219:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533238:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533244:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533250:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533287:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533294:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533300:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533306:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533313:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533318:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533324:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533344:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533352:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533357:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533362:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533368:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533374:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533379:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533384:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533390:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533394:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533399:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533404:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533423:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533430:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533435:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533441:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533446:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533459:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533466:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533472:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533478:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533484:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533492:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940803.533507:0:15766:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788940803.541866:0:15766:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788940821.929042:0:16529:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788940832.329134:0:17129:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788940832.329141:0:17129:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788940832.329142:0:17129:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788940832.329424:0:17129:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91cf08ce7800 00000020:01000004:3.0:1788940832.329868:0:17129:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788940832.329880:0:17129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788940832.329905:0:17129:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff91cf084499d8) 00000020:00000080:3.0:1788940832.329922:0:17129:0:(obd_config.c:786:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788940832.471231:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788940832.471994:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788940832.477019:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788940832.485033:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788940832.485461:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788940832.487492:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788940832.489582:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788940832.491292:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788940832.494110:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788940832.496990:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788940832.497943:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788940832.499644:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788940832.500123:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788940832.500696:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788940832.501029:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788940832.501936:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788940832.502912:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788940832.503553:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788940832.504009:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788940832.505081:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788940832.506134:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788940832.506587:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788940832.506806:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788940832.507024:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788940832.507292:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788940832.507554:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788940832.507804:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788940832.508021:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788940832.508499:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788940832.508700:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788940832.509014:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788940832.509487:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788940832.509661:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788940832.509956:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788940832.510655:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788940832.511678:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788940832.511921:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788940832.512524:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788940832.512761:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788940832.513056:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788940832.513903:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788940832.514123:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788940832.515181:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788940832.515586:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788940832.515918:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788940832.516156:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788940832.516542:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788940832.518601:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788940832.519599:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788940832.520707:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1788940832.527745:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1788940832.528636:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1788940832.528968:0:17129:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:0.0:1788940832.529784:0:17129:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788940832.531063:0:17129:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788940832.531072:0:17129:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788940832.531088:0:17129:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08bade211 00000020:01000004:0.0:1788940832.531096:0:17129:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788940832.531101:0:17129:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788940832.531106:0:17129:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91cf08ce7800 from MGS 00000020:01000004:0.0:1788940832.531110:0:17129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788940832.531122:0:17129:0:(genops.c:415:class_newdev()) Allocate new device MGS (ffff91cf07a033b0) 00000020:00000080:0.0:1788940832.531132:0:17129:0:(obd_config.c:786:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788940832.531619:0:17129:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91cf08ce7800 from MGS, refs=2 00080000:01000000:0.0:1788940832.531625:0:17129:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788940832.531632:0:17129:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08bade21f 00000100:00100000:0.0:1788940832.531737:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788940832.533227:0:17129:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788940832.533237:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788940832.543763:0:17129:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788940832.543780:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788940832.544963:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940832.547100:0:17129:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788940832.547113:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788940832.549818:0:17129:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788940832.549833:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788940832.551057:0:17129:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788940832.551066:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788940832.560214:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940832.560220:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940832.560222:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940832.561022:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940832.561025:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940832.561027:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940832.561669:0:17129:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788940832.566426:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788940832.584978:0:17129:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788940832.587576:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788940832.587725:0:17129:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788940832.587775:0:17129:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788940832.589723:0:17129:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788940832.591379:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940832.591774:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788940832.591781:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788940832.593913:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788940832.593924:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788940832.595090:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788940832.595098:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1788940832.596605:0:17146:0:(pinger.c:501:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1788940832.596749:0:17129:0:(obd_config.c:900:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788940832.596771:0:17129:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.125@tcp' 00000020:01000004:0.0:1788940832.596773:0:17129:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788940832.597655:0:17129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.125@tcp (typ=mgc) 00000020:00000080:0.0:1788940832.597670:0:17129:0:(genops.c:415:class_newdev()) Allocate new device MGC192.168.202.125@tcp (ffff91cf07a04d88) 00000020:00000080:0.0:1788940832.597688:0:17129:0:(obd_config.c:786:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788940832.597782:0:17129:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d005e87800@MGC192.168.202.125@tcp: add connection 192.168.202.125@tcp at head 00010000:00010000:0.0:1788940832.599598:0:17129:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.125@tcp-0 is initialized 00000040:01000000:0.0:1788940832.599612:0:17129:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788940832.621030:0:17147:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788940832.621633:0:17129:0:(obd_config.c:900:class_setup()) finished setup of obd MGC192.168.202.125@tcp (uuid 303c4994-a6d4-4c7c-823f-eb7dad50725e) 00000020:00000080:0.0:1788940832.621664:0:17129:0:(genops.c:1393:class_connect()) connect: client 303c4994-a6d4-4c7c-823f-eb7dad50725e, cookie 0x9c34acc08bade22d 00000100:00080000:0.0:1788940832.621677:0:17129:0:(import.c:545:import_select_connection()) MGC192.168.202.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788940832.621685:0:17129:0:(import.c:665:import_select_connection()) MGC192.168.202.125@tcp: import ffff91d005e87800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1788940832.621726:0:17129:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf07fd8a80 x1875839944942464/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788940832.621748:0:17129:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import 303c4994-a6d4-4c7c-823f-eb7dad50725e->MGS 00000020:01000004:0.0:1788940832.621778:0:17129:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788940832.621785:0:17129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788940832.621813:0:17129:0:(genops.c:415:class_newdev()) Allocate new device MDS (ffff91cf07a00000) 00000020:00000080:0.0:1788940832.621826:0:17129:0:(obd_config.c:786:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788940832.624547:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:303c4994-a6d4-4c7c-823f-eb7dad50725e:3644:1875839944942464:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788940832.624641:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940832.624936:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944942464 00000100:00100000:0.0:1788940832.624956:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944942464 00000100:00100000:0.0:1788940832.625010:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940832.625019:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1875839944942464:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788940832.625050:0:17143:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 303c4994-a6d4-4c7c-823f-eb7dad50725e@0@lo t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:0.0:1788940832.625087:0:17143:0:(genops.c:1393:class_connect()) connect: client 303c4994-a6d4-4c7c-823f-eb7dad50725e, cookie 0x9c34acc08bade23b 00000100:00080000:0.0:1788940832.625253:0:17143:0:(import.c:65:import_set_state_nolock()) ffff91d005e84800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940832.628032:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+5:3644:x1875839944942464:12345-0@lo:250:mount.lustre.0 Request processed in 3005us (3383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940832.628046:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940832.628129:0:3644:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788940832.628138:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.125@tcp: connect to target with instance 0 00000100:00080000:0.0:1788940832.628145:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788940832.628151:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788940832.628155:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d005e87800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788940832.629126:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788940832.629137:0:3644:0:(pinger.c:187:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788940832.629147:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:303c4994-a6d4-4c7c-823f-eb7dad50725e:3644:1875839944942464:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788940832.643096:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940832.644928:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788940832.644939:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788940832.649807:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788940832.649820:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788940832.651680:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788940832.651694:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788940832.654504:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940832.654740:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788940832.654748:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788940832.658541:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788940832.658557:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788940832.721923:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940832.722149:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788940832.722157:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788940832.726219:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788940832.726235:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788940832.726921:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940832.727123:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788940832.727128:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788940832.727720:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788940832.727727:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788940832.734476:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940832.734691:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788940832.734697:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788940832.737604:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788940832.737622:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788940832.738236:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940832.738444:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788940832.738449:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788940832.742791:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788940832.742891:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788940832.780742:0:17129:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940832.781028:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788940832.781036:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788940832.782592:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788940832.782603:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788940832.783989:0:17129:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788940832.784002:0:17129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788940832.787970:0:17129:0:(obd_config.c:900:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788940832.788006:0:17129:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788940832.788013:0:17129:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788940832.788129:0:17129:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788940832.788165:0:17129:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.125@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788940832.788169:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788940832.788171:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788940832.788172:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940832.788173:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940832.788187:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940832.788188:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940832.788189:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940832.788191:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788940832.788193:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940832.788194:0:17129:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940832.788197:0:17129:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788940832.788204:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940832.788205:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788940832.788206:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940832.788207:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940832.788208:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940832.788209:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940832.788210:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940832.788211:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788940832.788211:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940832.788212:0:17129:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940832.788244:0:17129:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788940832.788304:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944942592:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788940832.788383:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940832.788435:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d004f596c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940832.788458:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944942592 00000100:00100000:0.0:1788940832.788466:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944942592 00000100:00100000:0.0:1788940832.788511:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940832.788522:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+5:17129:x1875839944942592:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788940832.788582:0:17145:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788940832.788585:0:17145:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788940832.788588:0:17145:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788940832.790713:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788940832.791317:0:17145:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1788940832.793044:0:17167:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788940832.793051:0:17167:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788940832.793055:0:17167:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788940832.793057:0:17167:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788940832.793222:0:17167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788940832.793833:0:17145:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788940832.793844:0:17145:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788940832.796027:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+5:17129:x1875839944942592:12345-0@lo:253:mount.lustre.0 Request processed in 7493us (7631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940832.796047:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940832.798860:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944942592:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788940832.798894:0:17129:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788940832.798898:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788940832.798900:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788940832.798902:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940832.798903:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940832.798904:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940832.798905:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940832.798907:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788940832.798909:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788940832.798910:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940832.798912:0:17129:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788940832.798938:0:17129:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91cf08ce7800 from lustre-MDT0000 10000000:01000000:0.0:1788940832.798972:0:17129:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788940832.798976:0:17129:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788940832.798980:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91cf07a04d88 10000000:01000000:0.0:1788940832.798985:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788940832.798995:0:17129:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91cf07a04d88 from 1 10000000:01000000:0.0:1788940832.798999:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788940832.799044:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940832.799072:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940832.799083:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940832.799104:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944942720:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788940832.799165:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940832.799198:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944942720 00000100:00100000:2.0:1788940832.799204:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944942720 00000100:00100000:0.0:1788940832.799208:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02c243780 going to sleep for 11 seconds 00000100:00100000:1.0:1788940832.799381:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940832.799395:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+5:17129:x1875839944942720:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940832.799410:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940832.799425:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d004603e00/0x9c34acc08bade249 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade242 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.799453:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d004603e00/0x9c34acc08bade249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade242 expref: 6 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.799464:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d004603e00/0x9c34acc08bade249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade242 expref: 6 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.799473:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603e00, rc 0) 00000100:00100000:1.0:1788940832.799514:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+6:17129:x1875839944942720:12345-0@lo:101:mount.lustre.0 Request processed in 122us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940832.799521:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940832.799606:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944942720:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940832.799619:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade249 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940832.799628:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade249 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940832.799677:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944942848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940832.799702:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940832.799732:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02c243780 going to sleep for 11 seconds 00000100:00100000:2.0:1788940832.799786:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944942848 00000100:00100000:2.0:1788940832.799791:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944942848 00000100:00100000:2.0:1788940832.799821:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940832.799828:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+6:17129:x1875839944942848:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940832.799920:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+6:17129:x1875839944942848:12345-0@lo:501:mount.lustre.0 Request processed in 92us (217us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788940832.799927:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788940832.799996:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944942848:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788940832.800022:0:17129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788940832.800042:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade249 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.800059:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade249 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940832.800066:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91cf08ce7800 10000000:01000000:1.0:1788940832.800070:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788940832.800074:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91cf08ce7800 10000000:01000000:1.0:1788940832.800077:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788940832.800080:0:17129:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91cf08ce7800 from 1 10000000:01000000:1.0:1788940832.800082:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788940832.800098:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603600/0x9c34acc08bade250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.800106:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d004603600/0x9c34acc08bade250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.800113:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d004603600/0x9c34acc08bade250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940832.800126:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944942976:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940832.800152:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940832.800168:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d018b46300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940832.800181:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944942976 00000100:00100000:1.0:1788940832.800185:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944942976 00000100:00100000:1.0:1788940832.800206:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788940832.800212:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d010d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+6:17129:x1875839944942976:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940832.800220:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940832.800229:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d004602400/0x9c34acc08bade257 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade250 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.800253:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d004602400/0x9c34acc08bade257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade250 expref: 7 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.800289:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d004602400/0x9c34acc08bade257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade250 expref: 7 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.800296:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602400, rc 0) 00000100:00100000:1.0:1788940832.800323:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d010d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+7:17129:x1875839944942976:12345-0@lo:101:mount.lustre.0 Request processed in 111us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940832.800330:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788940832.800359:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944942976:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940832.800369:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d004603600/0x9c34acc08bade250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade257 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.800376:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d004603600/0x9c34acc08bade250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade257 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940832.800386:0:17129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788940832.800390:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603600/0x9c34acc08bade250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade257 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.800396:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d004603600/0x9c34acc08bade250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade257 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940832.800402:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788940832.800406:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788940832.800410:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91cf08ce7800 10000000:01000000:1.0:1788940832.800418:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788940832.800421:0:17129:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788940832.800423:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788940832.800436:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08bade25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.800443:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08bade25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.800451:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08bade25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940832.800463:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944943104:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940832.800486:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940832.800501:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d018b46300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940832.800513:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944943104 00000100:00100000:1.0:1788940832.800516:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944943104 00000100:00100000:1.0:1788940832.800532:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940832.800537:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+7:17129:x1875839944943104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940832.800543:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940832.800550:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d004603800/0x9c34acc08bade265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade25e expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.800563:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d004603800/0x9c34acc08bade265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade25e expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.800571:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d004603800/0x9c34acc08bade265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade25e expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.800577:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603800, rc 0) 00000100:00100000:1.0:1788940832.800612:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+8:17129:x1875839944943104:12345-0@lo:101:mount.lustre.0 Request processed in 74us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940832.800617:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940832.800645:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944943104:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940832.800655:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08bade25e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade265 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.800663:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08bade25e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade265 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940832.800701:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944943232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940832.800722:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940832.800734:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d018b46300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940832.800746:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944943232 00000100:00100000:1.0:1788940832.800750:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944943232 00000100:00100000:1.0:1788940832.800766:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940832.800772:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+8:17129:x1875839944943232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940832.800878:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+9:17129:x1875839944943232:12345-0@lo:501:mount.lustre.0 Request processed in 106us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940832.800895:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940832.800925:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944943232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940832.800948:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944943360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940832.800986:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940832.800999:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d018b669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940832.801010:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944943360 00000100:00100000:1.0:1788940832.801014:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944943360 00000100:00100000:1.0:1788940832.801034:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788940832.801039:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08583c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+9:17129:x1875839944943360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940832.807239:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08583c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+9:17129:x1875839944943360:12345-0@lo:503:mount.lustre.0 Request processed in 6188us (6241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940832.807253:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788940832.807402:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944943360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940832.807969:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:303c4994-a6d4-4c7c-823f-eb7dad50725e:17168:1875839944943488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940832.808023:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940832.808063:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00df43d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940832.808118:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944943488 00000100:00100000:0.0:1788940832.808124:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944943488 00000100:00100000:0.0:1788940832.808169:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788940832.808191:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+9:17168:x1875839944943488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940832.812703:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+9:17168:x1875839944943488:12345-0@lo:502:llog_process_th.0 Request processed in 4504us (4669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940832.812720:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788940832.812852:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:303c4994-a6d4-4c7c-823f-eb7dad50725e:17168:1875839944943488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788940832.812899:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940832.812911:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940832.812913:0:17168:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788940832.812919:0:17168:0:(obd_config.c:2066:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788940832.812922:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788940832.812937:0:17168:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff91d035a88000) 00000020:00000080:2.0:1788940832.812955:0:17168:0:(obd_config.c:786:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788940832.812961:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788940832.813043:0:17168:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788940832.813051:0:17168:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08bade273 00000020:00000080:2.0:1788940832.813304:0:17168:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788940832.813309:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940832.813312:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940832.813314:0:17168:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788940832.813317:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940832.813320:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940832.813322:0:17168:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788940832.813325:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788940832.813332:0:17168:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000 (ffff91d035a8cd88) 00000020:00000080:2.0:1788940832.813342:0:17168:0:(obd_config.c:786:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788940832.813346:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788940832.813348:0:17168:0:(obd_config.c:1615:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788940832.813351:0:17168:0:(obd_config.c:1248:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788940832.813357:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788940832.813398:0:17168:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91cf08ce7800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788940832.813412:0:17168:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDD0000 (ffff91d035a899d8) 00000020:00000080:2.0:1788940832.813428:0:17168:0:(obd_config.c:786:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788940832.813489:0:17168:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788940832.813496:0:17168:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08bade288 00000020:00000080:2.0:1788940832.813592:0:17168:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788940832.813599:0:17168:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788940832.813603:0:17168:0:(genops.c:1393:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9c34acc08bade28f 00080000:01000000:2.0:1788940832.813608:0:17168:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788940832.813611:0:17168:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08bade296 00010000:00010000:3.0:1788940832.898801:0:17168:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788940832.900537:0:17168:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:3.0:1788940832.900961:0:17168:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788940832.901606:0:17168:0:(genops.c:415:class_newdev()) Allocate new device lustre-QMT0000 (ffff91cf08448000) 00000020:00000080:3.0:1788940832.901625:0:17168:0:(obd_config.c:786:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788940832.901690:0:17168:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788940832.901697:0:17168:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08bade2a4 00000020:00000080:1.0:1788940832.903723:0:17168:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788940832.908075:0:17168:0:(genops.c:1393:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9c34acc08bade2ab 00000020:00000080:0.0:1788940832.914984:0:17168:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788940832.915000:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940832.915010:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940832.915012:0:17168:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788940832.915017:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788940832.915020:0:17168:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788940832.915021:0:17168:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788940832.915023:0:17168:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788940832.915024:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788940832.915027:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940832.915029:0:17168:0:(obd_config.c:1662:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788940832.915032:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940832.915037:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940832.915039:0:17168:0:(obd_config.c:1662:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788940832.915044:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788940832.915098:0:17168:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788940832.915117:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940832.915120:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940832.915121:0:17168:0:(obd_config.c:1662:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788940832.915123:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940832.915126:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940832.915128:0:17168:0:(obd_config.c:1662:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788940832.915131:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788940832.915136:0:17168:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:00000080:0.0:1788940832.915162:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788940832.915178:0:17168:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff91cf07a019d8) 00000020:00000080:0.0:1788940832.915193:0:17168:0:(obd_config.c:786:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788940832.915198:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788940832.915253:0:17168:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788940832.915277:0:17168:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788940832.915285:0:17168:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08bade2b9 00010000:00080000:0.0:1788940832.915316:0:17168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d005e81000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1788940832.931788:0:17168:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788940832.934343:0:17168:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788940832.934358:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788940832.934402:0:17168:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788940832.934421:0:17168:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08bade2c0 00000100:00080000:3.0:1788940832.934431:0:17168:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788940832.934436:0:17168:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff91d005e81000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940832.934479:0:17168:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d020c8f100 x1875839944943616/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788940832.934496:0:17168:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788940832.934548:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940832.934555:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940832.934557:0:17168:0:(obd_config.c:1662:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788940832.934560:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788940832.934563:0:17168:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788940832.934564:0:17168:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788940832.934566:0:17168:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788940832.934567:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788940832.934569:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940832.934571:0:17168:0:(obd_config.c:1662:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788940832.934573:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788940832.934578:0:17168:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788940832.934581:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940832.934582:0:17168:0:(obd_config.c:1662:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788940832.934585:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788940832.934588:0:17168:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:3.0:1788940832.934609:0:17168:0:(obd_config.c:2073:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788940832.934611:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788940832.934622:0:17168:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91cf0844cd88) 00000020:00000080:3.0:1788940832.934633:0:17168:0:(obd_config.c:786:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788940832.934637:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788940832.934692:0:17168:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788940832.934698:0:17168:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788940832.934702:0:17168:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08bade2ce 00010000:00080000:3.0:1788940832.934730:0:17168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d03ece2000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:3.0:1788940832.935074:0:17168:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1788940832.935933:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944943616:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788940832.936008:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940832.936134:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944943616 00000100:00100000:3.0:1788940832.936143:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944943616 00000040:01000000:2.0:1788940832.936359:0:17168:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788940832.936381:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940832.936389:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875839944943616:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788940832.936408:0:17155:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788940832.936667:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875839944943616:12345-0@lo:38:llog_process_th.0 Request processed in 275us (657us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788940832.936680:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:2.0:1788940832.936727:0:17168:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:0.0:1788940832.936909:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d005e81000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940832.936915:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788940832.936919:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944943616:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788940832.941452:0:17168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788940832.941698:0:17168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788940832.950247:0:17168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788940832.951015:0:17174:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788940832.951020:0:17174:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788940832.952720:0:17168:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788940832.952733:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788940832.952774:0:17168:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788940832.952801:0:17168:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08bade2d5 00000100:00080000:1.0:1788940832.952812:0:17168:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788940832.952819:0:17168:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91d03ece2000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940832.952856:0:17168:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf079e8e00 x1875839944943744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940832.952925:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944943744:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788940832.952983:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839944943744 offset 0 length 520: 4 00000100:00080000:1.0:1788940832.953044:0:17168:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788940832.953104:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940832.953109:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940832.953111:0:17168:0:(obd_config.c:1662:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788940832.953114:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788940832.953117:0:17168:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788940832.953119:0:17168:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788940832.953121:0:17168:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788940832.953122:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788940832.953124:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940832.953125:0:17168:0:(obd_config.c:1662:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788940832.953127:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788940832.953131:0:17168:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788940832.953134:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940832.953146:0:17168:0:(obd_config.c:1662:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788940832.953149:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788940832.953153:0:17168:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:1.0:1788940832.953172:0:17168:0:(obd_config.c:2073:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788940832.953378:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788940832.953392:0:17168:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91cf06cd8000) 00000020:00000080:1.0:1788940832.953405:0:17168:0:(obd_config.c:786:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788940832.953411:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788940832.953562:0:17168:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788940832.953568:0:17168:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788940832.953575:0:17168:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08bade2e3 00010000:00080000:1.0:1788940832.953606:0:17168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d03ed25000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1788940832.953810:0:17168:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788940832.953893:0:17168:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788940832.953909:0:17168:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788940832.956478:0:17168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940832.956770:0:17168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788940832.956934:0:17168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788940832.958787:0:17176:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788940832.958807:0:17176:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788940832.959808:0:17168:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788940832.959821:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788940832.959860:0:17168:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788940832.959890:0:17168:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08bade2ea 00000100:00080000:2.0:1788940832.959901:0:17168:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788940832.959908:0:17168:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d03ed25000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788940832.959946:0:17168:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d018b0bb80 x1875839944943872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788940832.959976:0:17168:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788940832.960035:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940832.960039:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940832.960041:0:17168:0:(obd_config.c:1662:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788940832.960044:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940832.960048:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940832.960049:0:17168:0:(obd_config.c:1662:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788940832.960052:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788940832.960053:0:17168:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788940832.960062:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940832.960064:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940832.960065:0:17168:0:(obd_config.c:1662:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788940832.960067:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940832.960069:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940832.960071:0:17168:0:(obd_config.c:1662:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788940832.960074:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788940832.960107:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b08700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:303c4994-a6d4-4c7c-823f-eb7dad50725e:17168:1875839944944000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940832.960477:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944943872:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788940832.960507:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839944943872 offset 0 length 520: 4 00000100:00100000:2.0:1788940832.960661:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940832.960713:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd000 going to sleep for 11 seconds 00000100:00100000:1.0:1788940832.963697:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944944000 00000100:00100000:1.0:1788940832.963717:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944944000 00000100:00100000:1.0:1788940832.963784:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940832.963805:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08583450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+9:17168:x1875839944944000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940832.964024:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08583450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+9:17168:x1875839944944000:12345-0@lo:502:llog_process_th.0 Request processed in 231us (3362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940832.964032:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788940832.964409:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b08700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:303c4994-a6d4-4c7c-823f-eb7dad50725e:17168:1875839944944000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940832.964460:0:17168:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940832.964469:0:17168:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940832.964471:0:17168:0:(obd_config.c:1662:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788940832.964478:0:17168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788940832.964777:0:17129:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788940832.964812:0:17129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788940832.964834:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08bade25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade265 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.964859:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08bade25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade265 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940832.964868:0:17129:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91cf08ce7800 from 1 10000000:01000000:1.0:1788940832.964871:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788940832.964915:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602600/0x9c34acc08bade2f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.964924:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d004602600/0x9c34acc08bade2f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.964934:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d004602600/0x9c34acc08bade2f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940832.964955:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944944128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940832.964997:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940832.965036:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0210ffcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940832.965197:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944944128 00000100:00100000:3.0:1788940832.965203:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944944128 00000100:00100000:3.0:1788940832.965238:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788940832.965246:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+9:17129:x1875839944944128:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940832.965293:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940832.965307:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d001219e00/0x9c34acc08bade2f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade2f1 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940832.965328:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001219e00/0x9c34acc08bade2f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade2f1 expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940832.965339:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d001219e00/0x9c34acc08bade2f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade2f1 expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940832.965348:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219e00, rc 0) 00000100:00100000:3.0:1788940832.965381:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+10:17129:x1875839944944128:12345-0@lo:101:mount.lustre.0 Request processed in 135us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940832.965387:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788940832.965617:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944944128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940832.965631:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d004602600/0x9c34acc08bade2f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade2f8 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940832.965640:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d004602600/0x9c34acc08bade2f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade2f8 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940832.966418:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944944256:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788940832.966536:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940832.966602:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0210ffcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940832.968242:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944944256 00000100:00100000:3.0:1788940832.968273:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944944256 00000100:00100000:3.0:1788940832.968340:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788940832.968351:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+10:17129:x1875839944944256:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788940832.968379:0:17145:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788940832.968387:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788940832.968522:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+10:17129:x1875839944944256:12345-0@lo:256:mount.lustre.0 Request processed in 173us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940832.968528:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940832.969597:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944944256:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788940832.970172:0:17129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788940832.970209:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602600/0x9c34acc08bade2f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade2f8 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940832.970222:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d004602600/0x9c34acc08bade2f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade2f8 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940832.970230:0:17129:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91cf08ce7800 from 1 10000000:01000000:0.0:1788940832.970233:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788940832.970296:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584ca00/0x9c34acc08bade2ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940832.970305:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584ca00/0x9c34acc08bade2ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940832.970315:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584ca00/0x9c34acc08bade2ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940832.970347:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944944384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788940832.970397:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940832.970434:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02c243c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940832.971593:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944944384 00000100:00100000:3.0:1788940832.971605:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944944384 00000100:00100000:3.0:1788940832.971657:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788940832.971667:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08583050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+10:17129:x1875839944944384:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940832.971681:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940832.971698:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d001218200/0x9c34acc08bade306 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade2ff expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940832.971726:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001218200/0x9c34acc08bade306 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade2ff expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940832.971737:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d001218200/0x9c34acc08bade306 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade2ff expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940832.971746:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001218200, rc 0) 00000100:00100000:3.0:1788940832.971825:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08583050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+11:17129:x1875839944944384:12345-0@lo:101:mount.lustre.0 Request processed in 159us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940832.971832:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788940832.971948:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944944384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940832.971973:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584ca00/0x9c34acc08bade2ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade306 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940832.971984:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584ca00/0x9c34acc08bade2ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade306 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940832.972062:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944944512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940832.972094:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940832.972130:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940832.972203:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944944512 00000100:00100000:0.0:1788940832.972207:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944944512 00000100:00100000:0.0:1788940832.972227:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940832.972233:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+11:17129:x1875839944944512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940832.972391:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+11:17129:x1875839944944512:12345-0@lo:501:mount.lustre.0 Request processed in 157us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940832.972399:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788940832.972584:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944944512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940832.972618:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944944640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940832.972664:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940832.972687:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359dd000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940832.972842:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944944640 00000100:00100000:0.0:1788940832.972849:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944944640 00000100:00100000:0.0:1788940832.972871:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788940832.972877:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+11:17129:x1875839944944640:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940832.974653:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+11:17129:x1875839944944640:12345-0@lo:503:mount.lustre.0 Request processed in 1768us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940832.974665:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788940832.980599:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944944640:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940832.981084:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:303c4994-a6d4-4c7c-823f-eb7dad50725e:17178:1875839944944768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940832.981162:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940832.981209:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02e9fae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940832.981283:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944944768 00000100:00100000:3.0:1788940832.981291:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944944768 00000100:00100000:3.0:1788940832.981341:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788940832.981351:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+11:17178:x1875839944944768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940832.981888:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+11:17178:x1875839944944768:12345-0@lo:502:llog_process_th.0 Request processed in 528us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940832.981898:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788940832.981993:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:303c4994-a6d4-4c7c-823f-eb7dad50725e:17178:1875839944944768:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788940832.982023:0:17178:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940832.982034:0:17178:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940832.982036:0:17178:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788940832.982044:0:17178:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91cf08ce7800 00000020:00000080:1.0:1788940832.982046:0:17178:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788940832.982055:0:17178:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940832.982057:0:17178:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940832.982059:0:17178:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788940832.982061:0:17178:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940832.982064:0:17178:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940832.982065:0:17178:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788940832.982068:0:17178:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91cf08ce7800 00000020:00000080:1.0:1788940832.982070:0:17178:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788940832.982132:0:17178:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940832.982135:0:17178:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940832.982137:0:17178:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788940832.982139:0:17178:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940832.982142:0:17178:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940832.982143:0:17178:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788940832.982147:0:17178:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91cf08ce7800 00000020:00000080:1.0:1788940832.982149:0:17178:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788940832.982166:0:17178:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940832.982169:0:17178:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940832.982170:0:17178:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788940832.982172:0:17178:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940832.982174:0:17178:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940832.982175:0:17178:0:(obd_config.c:1662:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788940832.982178:0:17178:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91cf08ce7800 00000020:00000080:1.0:1788940832.982187:0:17178:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788940832.982222:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:303c4994-a6d4-4c7c-823f-eb7dad50725e:17178:1875839944944896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940832.982279:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940832.982311:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02e9fae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940832.998630:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944944896 00000100:00100000:2.0:1788940832.998646:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944944896 00000100:00100000:2.0:1788940832.998725:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940832.998736:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+11:17178:x1875839944944896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940832.998927:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+11:17178:x1875839944944896:12345-0@lo:502:llog_process_th.0 Request processed in 193us (16671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940832.998935:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788940832.999906:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:303c4994-a6d4-4c7c-823f-eb7dad50725e:17178:1875839944944896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788940832.999948:0:17178:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940832.999956:0:17178:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940832.999959:0:17178:0:(obd_config.c:1662:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788940832.999963:0:17178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788940833.000959:0:17129:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788940833.000986:0:17129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940833.001005:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584ca00/0x9c34acc08bade2ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade306 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940833.001016:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584ca00/0x9c34acc08bade2ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade306 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940833.001068:0:17129:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788940833.001071:0:17129:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91cf08ce7800 10000000:01000000:2.0:1788940833.001074:0:17129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91cf08ce7800 10000000:01000000:2.0:1788940833.001077:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788940833.001084:0:17129:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91cf08ce7800 from 1 10000000:01000000:2.0:1788940833.001087:0:17129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788940833.001122:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e6000/0x9c34acc08bade30d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940833.001131:0:17129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d0355e6000/0x9c34acc08bade30d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940833.001141:0:17129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d0355e6000/0x9c34acc08bade30d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940833.001166:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944945024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788940833.001372:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940833.001613:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940833.006896:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944945024 00000100:00100000:2.0:1788940833.006914:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944945024 00000100:00100000:2.0:1788940833.006980:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940833.006992:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+11:17129:x1875839944945024:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940833.007012:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940833.007035:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0355e7400/0x9c34acc08bade314 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade30d expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940833.007063:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0355e7400/0x9c34acc08bade314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade30d expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940833.007076:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0355e7400/0x9c34acc08bade314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade30d expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940833.007086:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7400, rc 0) 00000100:00100000:2.0:1788940833.007172:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17129:x1875839944945024:12345-0@lo:101:mount.lustre.0 Request processed in 182us (5799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940833.007192:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940833.007284:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944945024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940833.007304:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d0355e6000/0x9c34acc08bade30d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade314 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940833.007313:0:17129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d0355e6000/0x9c34acc08bade30d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade314 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940833.007395:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944945152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940833.007435:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940833.007678:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940833.007762:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944945152 00000100:00100000:1.0:1788940833.007767:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944945152 00000100:00100000:1.0:1788940833.007802:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788940833.007810:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17129:x1875839944945152:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940833.007932:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17129:x1875839944945152:12345-0@lo:501:mount.lustre.0 Request processed in 123us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940833.007939:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940833.009650:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944945152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940833.009716:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944945280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940833.009783:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940833.009809:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940833.009830:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944945280 00000100:00100000:2.0:1788940833.009836:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944945280 00000100:00100000:2.0:1788940833.009890:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788940833.009899:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17129:x1875839944945280:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940833.010003:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17129:x1875839944945280:12345-0@lo:503:mount.lustre.0 Request processed in 105us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940833.010010:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788940833.010054:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944945280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940833.015171:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:303c4994-a6d4-4c7c-823f-eb7dad50725e:17183:1875839944945408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940833.016290:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940833.034121:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944945408 00000100:00100000:1.0:1788940833.034140:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944945408 00000100:00100000:1.0:1788940833.034200:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788940833.034212:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17183:x1875839944945408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940833.034746:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940833.035229:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17183:x1875839944945408:12345-0@lo:502:llog_process_th.0 Request processed in 1017us (18941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940833.035237:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788940833.035479:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:303c4994-a6d4-4c7c-823f-eb7dad50725e:17183:1875839944945408:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788940833.035569:0:17183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788940833.035589:0:17183:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff91d035a8b3b0) 00000020:00000080:2.0:1788940833.035610:0:17183:0:(obd_config.c:786:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788940833.035713:0:17183:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91cf08ce7800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788940833.035717:0:17183:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91cf08ce7800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788940833.035720:0:17183:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91cf08ce7800 4 00010000:00080000:2.0:1788940833.035753:0:17183:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d035479800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:2.0:1788940833.038763:0:17183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788940833.039987:0:17183:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788940833.040027:0:17183:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788940833.040042:0:17183:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9c34acc08bade322 00000100:00080000:2.0:1788940833.040053:0:17183:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788940833.040059:0:17183:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91d035479800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788940833.040095:0:17183:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d018b09880 x1875839944945536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788940833.040117:0:17183:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788940833.041460:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875839944945536:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788940833.041537:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940833.041709:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944945536 00000100:00100000:3.0:1788940833.041717:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944945536 00000100:00100000:3.0:1788940833.041745:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940833.041751:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875839944945536:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788940833.041905:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875839944945536:12345-0@lo:38:llog_process_th.0 Request processed in 151us (366us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788940833.041918:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940833.041963:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788940833.041971:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d035479800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940833.041976:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788940833.041980:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875839944945536:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788940833.044145:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b08a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:303c4994-a6d4-4c7c-823f-eb7dad50725e:17183:1875839944945664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940833.044233:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940833.044550:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944945664 00000100:00100000:2.0:1788940833.044558:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944945664 00000100:00100000:2.0:1788940833.047007:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788940833.047029:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17183:x1875839944945664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940833.047284:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17183:x1875839944945664:12345-0@lo:502:llog_process_th.0 Request processed in 263us (3049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940833.047293:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788940833.047355:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219ca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940833.047382:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b08a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:303c4994-a6d4-4c7c-823f-eb7dad50725e:17183:1875839944945664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940833.047475:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b08a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:303c4994-a6d4-4c7c-823f-eb7dad50725e:17183:1875839944945792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940833.047515:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940833.047545:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219ca6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940833.047566:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944945792 00000100:00100000:0.0:1788940833.047577:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944945792 00000100:00100000:0.0:1788940833.047623:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788940833.047630:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17183:x1875839944945792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940833.047718:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17183:x1875839944945792:12345-0@lo:502:llog_process_th.0 Request processed in 87us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940833.047725:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788940833.047786:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b08a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:303c4994-a6d4-4c7c-823f-eb7dad50725e:17183:1875839944945792:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788940833.047817:0:17183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788940833.049630:0:17129:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788940833.049697:0:17129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788940833.049715:0:17129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e6000/0x9c34acc08bade30d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade314 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940833.049731:0:17129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d0355e6000/0x9c34acc08bade30d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade314 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788940833.049793:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788940833.049796:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788940833.049797:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940833.049799:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940833.049800:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940833.049801:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940833.049803:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788940833.049804:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788940833.049806:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940833.049807:0:17129:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788940833.049811:0:17129:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788940833.049814:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788940833.049815:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788940833.049817:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940833.049818:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940833.049819:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940833.049820:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940833.049821:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788940833.049822:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788940833.049823:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940833.049824:0:17129:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788940833.049852:0:17129:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788940833.049871:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944945920:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788940833.049947:0:17129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940833.049981:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02c243c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940833.050689:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944945920 00000100:00100000:2.0:1788940833.050702:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944945920 00000100:00100000:2.0:1788940833.050761:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788940833.050772:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17129:x1875839944945920:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788940833.050815:0:17143:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788940833.050833:0:17143:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788940833.060233:0:17143:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788940833.060253:0:17143:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788940833.060382:0:17166:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788940833.060401:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788940833.060424:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d004603a00/0x9c34acc08bade329 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.060450:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d001219e00/0x9c34acc08bade2f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade2f1 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.060459:0:17166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d004603a00/0x9c34acc08bade329 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.060499:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d001219e00/0x9c34acc08bade2f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08bade2f1 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.060518:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d001219e00/0x9c34acc08bade2f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08bade2f1 expref: 12 pid: 17145 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940833.060535:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875839944946048:0@lo:104: 00000100:00100000:1.0:1788940833.060778:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940833.060831:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02e9fa840 going to sleep for 11 seconds 00000100:00100000:2.0:1788940833.061547:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944946048 00000100:00100000:2.0:1788940833.061557:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944946048 00000100:00100000:1.0:1788940833.061738:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940833.061749:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+3:17166:x1875839944946048:12345-0@lo:104: 00010000:00010000:1.0:1788940833.061763:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d004602600/0x9c34acc08bade2f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade2f8 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.061824:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788940833.061828:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+3:17166:x1875839944946048:12345-0@lo:104: Request processed in 82us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940833.061833:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788940833.061851:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940833.061855:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d004602600/0x9c34acc08bade2f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade2f8 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.061867:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602600 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940833.061871:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d004602600/0x9c34acc08bade2f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08bade2f8 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.061888:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d004602600/0x9c34acc08bade2f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08bade2f8 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940833.061896:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d004602600/0x9c34acc08bade2f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08bade2f8 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940833.061902:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788940833.061935:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d004602600/0x9c34acc08bade2f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade2f8 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.061941:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940833.061961:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d004602600/0x9c34acc08bade2f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade2f8 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.061968:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d004602600/0x9c34acc08bade2f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade2f8 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.061984:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940833.061986:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940833.061988:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940833.062013:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940833.062022:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944946176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940833.062057:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940833.062113:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944946176 00000100:00100000:1.0:1788940833.062117:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944946176 00010000:00010000:1.0:1788940833.062143:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d001219e00/0x9c34acc08bade2f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade2f1 expref: 13 pid: 17145 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940833.062175:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940833.062182:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+13:3645:x1875839944946176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940833.062192:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940833.062196:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d001219e00/0x9c34acc08bade2f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade2f1 expref: 13 pid: 17145 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.062208:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d001219e00/0x9c34acc08bade2f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08bade2f1 expref: 13 pid: 17145 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.062224:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d004603a00/0x9c34acc08bade329 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.062232:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d004603a00/0x9c34acc08bade329 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940833.062235:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+13:17129:x1875839944945920:12345-0@lo:253:mount.lustre.0 Request processed in 11462us (12285us total) trans 0 rc 0/0 20000000:01000000:1.0:1788940833.062247:0:17135:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001847474s 00000100:00100000:3.0:1788940833.062248:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788940833.062461:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17129:1875839944945920:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788940833.062474:0:17129:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788940833.062478:0:17129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788940833.062484:0:17129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788940833.062485:0:17129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940833.062487:0:17129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940833.062488:0:17129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940833.062489:0:17129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940833.062490:0:17129:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788940833.062491:0:17129:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788940833.062493:0:17129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940833.062495:0:17129:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788940833.062513:0:17129:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788940833.062545:0:17135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d004603a00/0x9c34acc08bade329 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.062558:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d004603a00/0x9c34acc08bade329 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.062565:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d004603a00/0x9c34acc08bade329 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.062572:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d004603a00/0x9c34acc08bade329 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.062578:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940833.062588:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d004603a00/0x9c34acc08bade329 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.062597:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d004603a00/0x9c34acc08bade329 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.062617:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d004603a00/0x9c34acc08bade329 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.062627:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940833.062666:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:3645:x1875839944946176:12345-0@lo:103:ldlm_bl.0 Request processed in 484us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940833.062673:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788940833.062704:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d001219e00/0x9c34acc08bade2f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08bade2f1 expref: 11 pid: 17145 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940833.062714:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875839944946048:0@lo:104: 00010000:00010000:1.0:1788940833.062727:0:17166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d004603a00/0x9c34acc08bade329 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.062735:0:17166:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d004603a00/0x9c34acc08bade329 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.062741:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d004603a00/0x9c34acc08bade329 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940833.062747:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d004603a00/0x9c34acc08bade329 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940833.062866:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944946176:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788940833.087044:0:17129:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788940833.087445:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788940833.087520:0:17189:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788940833.087524:0:17189:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1788940833.088096:0:17190:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788940833.088183:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788940833.088379:0:17190:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1788940833.090104:0:17191:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff91d018b09180 x1875839944946304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940833.090118:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00000040:00080000:0.0:1788940833.090566:0:17190:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:01000000:3.0:1788940833.090570:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788940833.090614:0:17129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788940833.090662:0:17190:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:3.0:1788940833.091142:0:17129:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788940833.091149:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788940833.091182:0:17129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940833.092327:0:17129:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788940833.092787:0:17129:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788940833.092814:0:17129:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788940833.094019:0:17129:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1788940833.095114:0:17129:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788940833.096971:0:17129:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788940833.097013:0:17129:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9d5841a27988 00100000:10000000:1.0:1788940833.097029:0:17129:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788940833.097713:0:17129:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788940833.097729:0:17129:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788940833.097748:0:17129:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788940833.097764:0:17129:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788940833.098593:0:17129:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788940833.098785:0:17129:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788940833.627516:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940834.078386:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788940834.152443:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 10000000:01000000:2.0:1788940834.410382:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788940834.410390:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91cf08ce7800 from 7 10000000:01000000:2.0:1788940834.410394:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788940834.410441:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e7200/0x9c34acc08bade330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940834.410453:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d0355e7200/0x9c34acc08bade330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940834.410465:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d0355e7200/0x9c34acc08bade330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940834.410505:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944946432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940834.410566:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940834.410608:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06f4e780 going to sleep for 11 seconds 00000100:00100000:2.0:1788940834.410647:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944946432 00000100:00100000:2.0:1788940834.410654:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944946432 00000100:00100000:2.0:1788940834.410706:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788940834.410714:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+11:17147:x1875839944946432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940834.410728:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940834.410740:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade330 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940834.410764:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade330 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940834.410774:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade330 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940834.410784:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7600, rc 0) 00000100:00100000:2.0:1788940834.410832:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17147:x1875839944946432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940834.410839:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788940834.410906:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944946432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940834.410920:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d0355e7200/0x9c34acc08bade330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940834.410928:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d0355e7200/0x9c34acc08bade330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940834.410981:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944946560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788940834.411011:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940834.411292:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06f4e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788940834.411503:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944946560 00000100:00100000:3.0:1788940834.411509:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944946560 00000100:00100000:3.0:1788940834.411547:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940834.411554:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17147:x1875839944946560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788940834.411570:0:17143:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788940834.411586:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788940834.411590:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788940834.411666:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17147:x1875839944946560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940834.411673:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788940834.415631:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944946560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788940834.415708:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788940834.415718:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e7200/0x9c34acc08bade330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940834.415730:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d0355e7200/0x9c34acc08bade330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940834.652397:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940835.104097:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788940835.165143:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00010000:00010000:2.0:1788940835.678278:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940836.190315:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00010000:00010000:3.0:1788940836.702944:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940837.211394:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00010000:00010000:1.0:1788940837.723549:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788940838.045673:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788940838.045680:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788940838.045684:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d005e81000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940838.045691:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 588 00000100:00080000:2.0:1788940838.045697:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788940838.045704:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff91d005e81000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788940838.045726:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d018b0b800 x1875839944946816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788940838.045742:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940838.045745:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788940838.045748:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940838.045759:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788940838.045762:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788940838.045765:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788940838.045767:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d035479800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940838.045772:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91d035479800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788940838.045784:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d018b09500 x1875839944946944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940838.046022:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940838.046036:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:303c4994-a6d4-4c7c-823f-eb7dad50725e:3648:1875839944946688:0@lo:400:kworker.0 00000100:00100000:0.0:1788940838.046104:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940838.046167:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944946816:0@lo:38:kworker.0 00000100:00100000:0.0:1788940838.046234:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940838.046253:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875839944946944:0@lo:38:kworker.0 00000100:00100000:0.0:1788940838.046306:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940838.046363:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944946816 00000100:00100000:0.0:1788940838.046370:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944946816 00000100:00100000:2.0:1788940838.049458:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944946688 00000100:00100000:2.0:1788940838.049473:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944946688 00000100:00100000:2.0:1788940838.049542:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940838.049553:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:3648:x1875839944946688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940838.049646:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:3648:x1875839944946688:12345-0@lo:400:kworker.0 Request processed in 95us (3542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940838.049653:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788940838.049877:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:303c4994-a6d4-4c7c-823f-eb7dad50725e:3648:1875839944946688:0@lo:400:kworker.0 00000100:00100000:0.0:1788940838.049923:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944946944 00000100:00100000:0.0:1788940838.049928:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944946944 00000100:00100000:0.0:1788940838.049949:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940838.049954:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875839944946944:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788940838.049977:0:17152:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 593 last 0 00000020:00000080:0.0:1788940838.050018:0:17152:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9c34acc08bade33e 00000004:00100000:0.0:1788940838.050033:0:17152:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788940838.050607:0:17152:0:(import.c:65:import_set_state_nolock()) ffff91d02ebf3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940838.050667:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875839944946944:12345-0@lo:38:kworker.0 Request processed in 711us (4359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940838.050675:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788940838.050712:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91d018b09500 x1875839944946944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788940838.050727:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788940838.050773:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788940838.050778:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788940838.050781:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d035479800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788940838.050787:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875839944946944:0@lo:38:kworker.0 00000100:00100000:0.0:1788940838.050812:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940838.050818:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875839944946816:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788940838.050829:0:17156:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788940838.089044:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875839944946816:12345-0@lo:38:kworker.0 Request processed in 38218us (42802us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788940838.089060:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788940838.089198:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d005e81000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940838.089205:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788940838.089210:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944946816:0@lo:38:kworker.0 00000100:00100000:1.0:1788940838.235912:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00000001:02000400:3.0:1788940838.574076:0:17434:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788940838.747802:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940839.275423:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00000020:00000004:3.0:1788940839.622952:0:17486:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788940839.623160:0:17486:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788940839.771765:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940840.286193:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00000020:00000004:3.0:1788940840.674181:0:17536:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788940840.674645:0:17536:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788940840.795641:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940841.308409:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00010000:00010000:1.0:1788940841.819447:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940842.161695:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940832/real 1788940832] req@ffff91d018b0bb80 x1875839944943872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940842 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940842.161725:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d018b0bb80 x1875839944943872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940842 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940842.161746:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940832/real 1788940832] req@ffff91cf079e8e00 x1875839944943744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940842 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940842.161757:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91cf079e8e00 x1875839944943744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940842 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788940842.161775:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03ed25000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940842.161804:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788940842.161808:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944943872:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788940842.161814:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03ece2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940842.161819:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788940842.161822:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944943744:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788940842.162745:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788940842.162750:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788940842.162753:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d005e81000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940842.162759:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 593 00000100:00080000:1.0:1788940842.162765:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788940842.162771:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff91d005e81000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940842.162801:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf079e8e00 x1875839944947200/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940842.162819:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940842.162823:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788940842.162824:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d03ece2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940842.162827:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 588 00000100:00080000:1.0:1788940842.162830:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788940842.162833:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91d03ece2000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940842.162842:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940842.162845:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf079ead80 x1875839944947328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940842.162853:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1788940842.162856:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944947072:0@lo:400:kworker.0 00000100:00080000:1.0:1788940842.162867:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788940842.162869:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d03ed25000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940842.162871:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 588 00000100:00080000:1.0:1788940842.162874:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788940842.162878:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d03ed25000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940842.162890:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf079eb480 x1875839944947456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940842.162927:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940842.162927:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944947584:0@lo:400:kworker.0 00000100:00100000:1.0:1788940842.162960:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940842.162982:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944947072 00000100:00100000:3.0:1788940842.162990:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944947072 00000100:00100000:1.0:1788940842.163012:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944947584 00000100:00100000:1.0:1788940842.163016:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944947584 00000100:00100000:3.0:1788940842.163035:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788940842.163037:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940842.163045:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d36e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:3647:x1875839944947072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940842.163045:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944947584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940842.163089:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944947584:12345-0@lo:400:kworker.0 Request processed in 45us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940842.163096:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940842.163098:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d36e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:3647:x1875839944947072:12345-0@lo:400:kworker.0 Request processed in 55us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940842.163103:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788940842.163143:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91cf079eb800 x1875839944947584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940842.163155:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944947584:0@lo:400:kworker.0 00000100:00100000:1.0:1788940842.163173:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944947200:0@lo:38:kworker.0 00000100:00100000:3.0:1788940842.167888:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944947072:0@lo:400:kworker.0 00000100:00100000:0.0:1788940842.176014:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940842.176063:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944947328:0@lo:8:kworker.0 00000400:00000100:0.0:1788940842.176088:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839944947328 offset 0 length 520: 4 00000100:00100000:0.0:1788940842.176111:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944947456:0@lo:8:kworker.0 00000400:00000100:0.0:1788940842.176127:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839944947456 offset 0 length 520: 4 00000100:00100000:3.0:1788940842.181287:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944947200 00000100:00100000:3.0:1788940842.181303:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944947200 00000100:00100000:3.0:1788940842.181362:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940842.181372:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875839944947200:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788940842.181392:0:17155:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788940842.242418:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875839944947200:12345-0@lo:38:kworker.0 Request processed in 61035us (66400us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788940842.242439:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788940842.242542:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d005e81000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940842.242549:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788940842.242553:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944947200:0@lo:38:kworker.0 00000100:00100000:1.0:1788940842.332194:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00010000:00010000:3.0:1788940842.843891:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940843.356352:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00010000:00010000:0.0:1788940843.870214:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940844.379634:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00010000:00010000:0.0:1788940844.897860:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940845.344932:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788940845.403360:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00010000:00010000:0.0:1788940845.915526:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940846.427716:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00010000:00010000:0.0:1788940846.939444:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788940847.260620:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788940847.260628:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788940847.260632:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d005e81000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940847.260641:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 597 00000100:00080000:3.0:1788940847.260647:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788940847.260655:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff91d005e81000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940847.260679:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d020c8e300 x1875839944947840/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788940847.260697:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940847.260701:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940847.260703:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940847.260718:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788940847.260785:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944947968:0@lo:400:kworker.0 00000100:00100000:0.0:1788940847.260830:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:303c4994-a6d4-4c7c-823f-eb7dad50725e:3646:1875839944947712:0@lo:400:kworker.0 00000100:00100000:3.0:1788940847.260856:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940847.260863:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940847.260944:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944947712 00000100:00100000:2.0:1788940847.260947:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944947840:0@lo:38:kworker.0 00000100:00100000:0.0:1788940847.260951:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944947712 00000100:00100000:0.0:1788940847.260998:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788940847.261008:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:3646:x1875839944947712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940847.261046:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940847.261055:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:3646:x1875839944947712:12345-0@lo:400:kworker.0 Request processed in 49us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940847.261075:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940847.261080:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944947840 00000100:00100000:2.0:1788940847.261084:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944947840 00000100:00100000:2.0:1788940847.261102:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940847.261107:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875839944947840:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788940847.261119:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:303c4994-a6d4-4c7c-823f-eb7dad50725e:3646:1875839944947712:0@lo:400:kworker.0 00010000:00020000:2.0:1788940847.261127:0:17156:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788940847.273875:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944947968 00000100:00100000:3.0:1788940847.273891:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944947968 00000100:00100000:3.0:1788940847.274067:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940847.274079:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944947968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940847.274174:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944947968:12345-0@lo:400:kworker.0 Request processed in 98us (13317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940847.274183:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788940847.278877:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91d020c8ea00 x1875839944947968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940847.278900:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944947968:0@lo:400:kworker.0 00000100:00100000:2.0:1788940847.288412:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875839944947840:12345-0@lo:38:kworker.0 Request processed in 27295us (27357us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788940847.288428:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788940847.288702:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d005e81000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940847.288709:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788940847.288713:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944947840:0@lo:38:kworker.0 00000100:00100000:3.0:1788940847.453462:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00010000:00010000:0.0:1788940847.964481:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940848.477987:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00000020:01000004:2.0:1788940848.552153:0:17881:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788940848.552157:0:17881:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788940848.552159:0:17881:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788940848.552301:0:17881:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91d03547c000 00000020:01000004:2.0:1788940848.552317:0:17881:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788940848.552329:0:17881:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788940848.552343:0:17881:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff91d00509b3b0) 00000020:00000080:2.0:1788940848.552359:0:17881:0:(obd_config.c:786:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788940848.703162:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788940848.706480:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788940848.710808:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788940848.711423:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788940848.712359:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788940848.712638:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1788940848.714097:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788940848.715367:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788940848.715874:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788940848.717430:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1788940848.718156:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788940848.721147:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788940848.721779:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788940848.722067:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788940848.725673:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1788940848.725960:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788940848.726584:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1788940848.727221:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788940848.727855:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788940848.728914:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788940848.729317:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788940848.729698:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1788940848.729965:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788940848.730702:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788940848.731399:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788940848.732089:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788940848.732592:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1788940848.732852:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788940848.735340:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788940848.735938:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788940848.736278:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1788940848.736591:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1788940848.737218:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1788940848.739634:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788940848.739962:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788940848.741341:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788940848.742365:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788940848.743404:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1788940848.743750:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1788940848.743996:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1788940848.745553:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788940848.746075:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788940848.747056:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788940848.747604:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1788940848.748126:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788940848.748613:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00080000:01000000:2.0:1788940848.751582:0:17881:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788940848.751829:0:17881:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788940848.751840:0:17881:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788940848.751853:0:17881:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9c34acc08bade34c 00000020:01000004:2.0:1788940848.751861:0:17881:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788940848.751882:0:17881:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788940848.751886:0:17881:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788940848.751892:0:17881:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788940848.751917:0:17881:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788940848.751920:0:17881:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788940848.764863:0:17881:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788940848.764909:0:17881:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.125@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788940848.764914:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788940848.764915:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788940848.764917:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940848.764918:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940848.764919:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940848.764920:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940848.764926:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940848.764928:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940848.764929:0:17881:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940848.764933:0:17881:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788940848.764935:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940848.764936:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788940848.764937:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940848.764938:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940848.764939:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940848.764940:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940848.764941:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940848.764942:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940848.764943:0:17881:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940848.767043:0:17881:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788940848.767073:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944948096:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788940848.767147:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940848.767208:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06f4e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788940848.767683:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944948096 00000100:00100000:0.0:1788940848.767693:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944948096 00000100:00100000:0.0:1788940848.767762:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788940848.767772:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17881:x1875839944948096:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788940848.767820:0:17144:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788940848.767824:0:17144:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788940848.767831:0:17144:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788940848.768516:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17881:x1875839944948096:12345-0@lo:253:mount.lustre.0 Request processed in 744us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940848.768526:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788940848.768608:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944948096:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788940848.768619:0:17881:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788940848.768622:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788940848.768624:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788940848.768625:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940848.768626:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940848.768627:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940848.768628:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940848.768629:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940848.768631:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940848.768632:0:17881:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788940848.768649:0:17881:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91d03547c000 from lustre-MDT0001 10000000:01000000:2.0:1788940848.768675:0:17881:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788940848.768677:0:17881:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788940848.768683:0:17881:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91cf07a04d88 local copy 00010000:00010000:2.0:1788940848.768692:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade249 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940848.768810:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944948224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940848.768844:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940848.768886:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06f4e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940848.769240:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944948224 00000100:00100000:0.0:1788940848.769246:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944948224 00000100:00100000:0.0:1788940848.769535:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788940848.769544:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d36dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17881:x1875839944948224:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940848.769629:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d36dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17881:x1875839944948224:12345-0@lo:501:mount.lustre.0 Request processed in 86us (783us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940848.769637:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788940848.769721:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944948224:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788940848.769749:0:17881:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788940848.769773:0:17881:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788940848.769780:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade249 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940848.769791:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade249 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940848.769816:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91d03547c000 10000000:01000000:3.0:1788940848.769821:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788940848.769825:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91cf07a04d88 10000000:01000000:3.0:1788940848.769827:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788940848.769838:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff91cf07a04d88 from 1 10000000:01000000:3.0:1788940848.769841:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788940848.769866:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d001219800/0x9c34acc08bade353 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940848.769875:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d001219800/0x9c34acc08bade353 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940848.769884:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d001219800/0x9c34acc08bade353 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940848.769899:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944948352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788940848.769926:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940848.769954:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a49600 going to sleep for 11 seconds 00000100:00100000:2.0:1788940848.770019:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944948352 00000100:00100000:2.0:1788940848.770023:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944948352 00000100:00100000:2.0:1788940848.770053:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788940848.770059:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d36d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+12:17881:x1875839944948352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940848.770068:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940848.770080:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0355e7c00/0x9c34acc08bade35a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade353 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940848.770099:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0355e7c00/0x9c34acc08bade35a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade353 expref: 13 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940848.770109:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0355e7c00/0x9c34acc08bade35a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade353 expref: 13 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940848.770117:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7c00, rc 0) 00000100:00100000:2.0:1788940848.770203:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d36d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+13:17881:x1875839944948352:12345-0@lo:101:mount.lustre.0 Request processed in 143us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940848.770210:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788940848.770824:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944948352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940848.770840:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d001219800/0x9c34acc08bade353 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade35a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940848.770849:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d001219800/0x9c34acc08bade353 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade35a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940848.770866:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788940848.770882:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d001219800/0x9c34acc08bade353 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade35a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940848.770890:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d001219800/0x9c34acc08bade353 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade35a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940848.770898:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91d03547c000 10000000:01000000:1.0:1788940848.770902:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788940848.770906:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91d03547c000 from 1 10000000:01000000:1.0:1788940848.770908:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788940848.770926:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603200/0x9c34acc08bade361 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940848.770933:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d004603200/0x9c34acc08bade361 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940848.770949:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d004603200/0x9c34acc08bade361 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940848.770964:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944948480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940848.770998:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940848.771027:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02004f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788940848.771085:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944948480 00000100:00100000:2.0:1788940848.771090:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944948480 00000100:00100000:2.0:1788940848.771126:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788940848.771134:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d36e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+13:17881:x1875839944948480:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940848.771151:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940848.771161:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0355e7000/0x9c34acc08bade368 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade361 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940848.771176:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0355e7000/0x9c34acc08bade368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade361 expref: 14 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940848.771192:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0355e7000/0x9c34acc08bade368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade361 expref: 14 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940848.771198:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7000, rc 0) 00000100:00100000:2.0:1788940848.771238:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d36e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+14:17881:x1875839944948480:12345-0@lo:101:mount.lustre.0 Request processed in 106us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940848.771245:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788940848.771789:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944948480:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940848.771801:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d004603200/0x9c34acc08bade361 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade368 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940848.771810:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d004603200/0x9c34acc08bade361 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade368 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940848.771824:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788940848.771828:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603200/0x9c34acc08bade361 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade368 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940848.771835:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d004603200/0x9c34acc08bade361 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade368 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940848.771841:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788940848.771845:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788940848.771850:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91d03547c000 10000000:01000000:1.0:1788940848.771852:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788940848.771855:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788940848.771858:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788940848.771874:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602200/0x9c34acc08bade36f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940848.771888:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d004602200/0x9c34acc08bade36f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940848.771895:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d004602200/0x9c34acc08bade36f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940848.771908:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944948608:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940848.771939:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940848.771968:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02004f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788940848.772027:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944948608 00000100:00100000:0.0:1788940848.772033:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944948608 00000100:00100000:0.0:1788940848.772063:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788940848.772071:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00ddca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+14:17881:x1875839944948608:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940848.772079:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940848.772092:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584d400/0x9c34acc08bade376 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade36f expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940848.772107:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584d400/0x9c34acc08bade376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade36f expref: 15 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940848.772124:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584d400/0x9c34acc08bade376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade36f expref: 15 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940848.772129:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584d400, rc 0) 00000100:00100000:0.0:1788940848.772182:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00ddca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+15:17881:x1875839944948608:12345-0@lo:101:mount.lustre.0 Request processed in 112us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940848.772188:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788940848.772329:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944948608:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940848.772341:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d004602200/0x9c34acc08bade36f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade376 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940848.772348:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d004602200/0x9c34acc08bade36f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade376 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940848.775119:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1788940848.778757:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940848.785562:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788940848.786015:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788940848.786037:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788940848.786052:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788940848.786066:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1788940848.786079:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1788940848.786094:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1788940848.786107:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788940848.786120:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788940848.786207:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1788940848.786240:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1788940848.786254:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1788940848.786664:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1788940848.786683:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788940848.786696:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788940848.786708:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1788940848.786722:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788940848.786745:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788940848.786760:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1788940848.786772:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788940848.786784:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788940848.786795:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788940848.786806:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788940848.786832:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1788940848.786838:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1788940848.786945:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944948736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940848.787020:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940848.787066:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02004f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940848.787235:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944948736 00000100:00100000:0.0:1788940848.787244:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944948736 00000100:00100000:0.0:1788940848.787348:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788940848.787359:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+15:17881:x1875839944948736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940848.787784:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+15:17881:x1875839944948736:12345-0@lo:501:mount.lustre.0 Request processed in 425us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940848.787793:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788940848.788279:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944948736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940848.788556:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944948864:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940848.788707:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940848.788754:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02004f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788940848.788858:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944948864 00000100:00100000:2.0:1788940848.788866:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944948864 00000100:00100000:2.0:1788940848.788909:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788940848.788919:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+15:17881:x1875839944948864:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940848.789973:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+15:17881:x1875839944948864:12345-0@lo:503:mount.lustre.0 Request processed in 1051us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940848.789984:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788940848.790202:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944948864:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788940848.790955:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788940848.791036:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944948992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940848.791094:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940848.791284:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02004f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788940848.802806:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944948992 00000100:00100000:3.0:1788940848.802821:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944948992 00000100:00100000:3.0:1788940848.802884:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788940848.802895:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+15:17881:x1875839944948992:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940848.803998:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+15:17881:x1875839944948992:12345-0@lo:502:mount.lustre.0 Request processed in 1101us (12899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940848.804010:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788940848.804126:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944948992:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788940848.804961:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788940848.804999:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1788940848.805017:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1788940848.805032:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1788940848.805047:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1788940848.805061:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1788940848.805075:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1788940848.805092:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1788940848.805107:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1788940848.805120:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1788940848.805149:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1788940848.805166:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1788940848.805179:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1788940848.805190:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1788940848.805214:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1788940848.805229:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1788940848.805243:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1788940848.805299:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1788940848.805553:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1788940848.805572:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1788940848.805587:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1788940848.805602:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1788940848.805614:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1788940848.805627:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1788940848.805639:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1788940848.805650:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1788940848.805663:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1788940848.805674:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1788940848.805686:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1788940848.805698:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1788940848.805709:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1788940848.805720:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1788940848.805744:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1788940848.805762:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1788940848.805778:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1788940848.805791:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1788940848.805806:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1788940848.805821:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1788940848.805835:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1788940848.805852:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1788940848.805867:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1788940848.805880:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1788940848.805894:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1788940848.805909:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1788940848.805958:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944949120:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940848.806029:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940848.806161:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06ff0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940848.810544:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944949120 00000100:00100000:2.0:1788940848.810562:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944949120 00000100:00100000:2.0:1788940848.810751:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788940848.810762:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+15:17881:x1875839944949120:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940848.810944:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+15:17881:x1875839944949120:12345-0@lo:502:mount.lustre.0 Request processed in 184us (4914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940848.810954:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788940848.811063:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944949120:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788940848.811158:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1788940848.811172:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788940848.816555:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940848.816587:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940848.816590:0:17885:0:(obd_config.c:1662:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788940848.816596:0:17885:0:(obd_config.c:2066:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788940848.816600:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788940848.816640:0:17885:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff91d017e599d8) 00000020:00000080:0.0:1788940848.816666:0:17885:0:(obd_config.c:786:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788940848.816673:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788940848.816765:0:17885:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788940848.816775:0:17885:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9c34acc08bade384 00000020:00000080:0.0:1788940848.817026:0:17885:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788940848.817031:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940848.817035:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940848.817037:0:17885:0:(obd_config.c:1662:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788940848.817040:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940848.817043:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940848.817045:0:17885:0:(obd_config.c:1662:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788940848.817048:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788940848.817055:0:17885:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0001 (ffff91d017e58000) 00000020:00000080:0.0:1788940848.817067:0:17885:0:(obd_config.c:786:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788940848.817072:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788940848.817074:0:17885:0:(obd_config.c:1615:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788940848.817077:0:17885:0:(obd_config.c:1248:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788940848.817083:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788940848.817133:0:17885:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d03547c000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788940848.817147:0:17885:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDD0001 (ffff91d017e5cd88) 00000020:00000080:0.0:1788940848.817156:0:17885:0:(obd_config.c:786:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788940848.817237:0:17885:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788940848.817249:0:17885:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08bade399 00000020:00000080:0.0:1788940848.817371:0:17885:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788940848.817378:0:17885:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788940848.817382:0:17885:0:(genops.c:1393:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x9c34acc08bade3a0 00080000:01000000:0.0:1788940848.817389:0:17885:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788940848.817392:0:17885:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9c34acc08bade3a7 00010000:00010000:2.0:1788940848.986207:0:17885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00010000:00010000:0.0:1788940848.988597:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788940848.989833:0:17885:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788940848.990676:0:17885:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788940848.999586:0:17885:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788940848.999602:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940848.999609:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940848.999611:0:17885:0:(obd_config.c:1662:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788940848.999615:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940848.999620:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940848.999621:0:17885:0:(obd_config.c:1662:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788940848.999625:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788940848.999630:0:17885:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:00000080:1.0:1788940848.999660:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788940848.999675:0:17885:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff91cf06cdcd88) 00000020:00000080:1.0:1788940848.999699:0:17885:0:(obd_config.c:786:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788940848.999705:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788940848.999785:0:17885:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788940848.999792:0:17885:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788940848.999799:0:17885:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9c34acc08bade3b5 00010000:00080000:1.0:1788940848.999834:0:17885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d03474e800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1788940849.001540:0:17885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788940849.005827:0:17885:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788940849.005842:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788940849.005900:0:17885:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788940849.005925:0:17885:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08bade3bc 00000100:00080000:2.0:1788940849.005937:0:17885:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788940849.005943:0:17885:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff91d03474e800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788940849.005984:0:17885:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d018b08000 x1875839944949248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788940849.006016:0:17885:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788940849.006097:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940849.006102:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940849.006104:0:17885:0:(obd_config.c:1662:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788940849.006108:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788940849.006111:0:17885:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788940849.006113:0:17885:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788940849.006114:0:17885:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788940849.006116:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788940849.006118:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940849.006119:0:17885:0:(obd_config.c:1662:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788940849.006122:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940849.006126:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940849.006128:0:17885:0:(obd_config.c:1662:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788940849.006132:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788940849.006168:0:17885:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788940849.006183:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940849.006186:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940849.006188:0:17885:0:(obd_config.c:1662:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788940849.006190:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788940849.006192:0:17885:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1788940849.006193:0:17885:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788940849.006195:0:17885:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788940849.006196:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788940849.006199:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940849.006200:0:17885:0:(obd_config.c:1662:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788940849.006202:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788940849.006211:0:17885:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788940849.006216:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940849.006217:0:17885:0:(obd_config.c:1662:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788940849.006220:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788940849.006224:0:17885:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:2.0:1788940849.006247:0:17885:0:(obd_config.c:2073:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788940849.006249:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788940849.006290:0:17885:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff91d0050999d8) 00000100:00100000:3.0:1788940849.006441:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944949248:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788940849.006508:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788940849.006743:0:17885:0:(obd_config.c:786:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000100:00100000:0.0:1788940849.006933:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944949248 00000100:00100000:0.0:1788940849.006941:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944949248 00000100:00100000:0.0:1788940849.006972:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940849.006980:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875839944949248:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788940849.007004:0:17155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 604 last 0 00000020:00000080:0.0:1788940849.007046:0:17155:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08bade3ca 00000004:00100000:0.0:1788940849.007060:0:17155:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788940849.007066:0:17155:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788940849.007145:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788940849.007149:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788940849.007152:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d005e81000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788940849.007157:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 602 00000100:00080000:0.0:1788940849.007160:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788940849.007165:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff91d005e81000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1788940849.007198:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf07fd9c00 x1875839944949376/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788940849.007216:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788940849.007219:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788940849.007222:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788940849.007224:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788940849.007281:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944949376:0@lo:38:kworker.0 00000100:00100000:0.0:1788940849.007379:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940849.007407:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944949504:0@lo:400:kworker.0 00000100:00100000:0.0:1788940849.007431:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940849.007460:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944949504 00000100:00100000:0.0:1788940849.007464:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944949504 00000100:00100000:0.0:1788940849.007494:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940849.007500:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944949504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940849.007541:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944949504:12345-0@lo:400:kworker.0 Request processed in 41us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940849.007547:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940849.007767:0:17156:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788940849.007776:0:17156:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000020:00000080:3.0:1788940849.007818:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788940849.007891:0:17885:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788940849.007898:0:17885:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788940849.007907:0:17885:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9c34acc08bade3d1 00010000:00080000:3.0:1788940849.007938:0:17885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d02e8d2800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:3.0:1788940849.008166:0:17885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:3.0:1788940849.009721:0:17885:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788940849.009925:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788940849.021982:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944949376 00000100:00100000:1.0:1788940849.021998:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944949376 00000040:00080000:2.0:1788940849.022025:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788940849.022146:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940849.022156:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1875839944949376:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788940849.022278:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1875839944949376:12345-0@lo:38:kworker.0 Request processed in 122us (14898us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788940849.022285:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940849.022467:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788940849.022476:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d005e81000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788940849.022480:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788940849.022484:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944949376:0@lo:38:kworker.0 00000040:00080000:2.0:1788940849.022797:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788940849.023026:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1788940849.025035:0:17891:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788940849.025043:0:17891:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00010000:00080000:1.0:1788940849.026676:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91cf07fd8380 x1875839944949504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940849.026700:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944949504:0@lo:400:kworker.0 00000020:00000080:2.0:1788940849.030026:0:17885:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788940849.030047:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788940849.030111:0:17885:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788940849.030143:0:17885:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08bade3d8 00000100:00080000:2.0:1788940849.030158:0:17885:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788940849.030165:0:17885:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff91d02e8d2800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788940849.030212:0:17885:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d018b0b480 x1875839944949632/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788940849.030248:0:17885:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788940849.030750:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944949632:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788940849.030825:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839944949632 offset 0 length 520: 4 00000100:00080000:0.0:1788940849.031774:0:17155:0:(import.c:65:import_set_state_nolock()) ffff91d034753800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940849.031874:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875839944949248:12345-0@lo:38:llog_process_th.0 Request processed in 24891us (25363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940849.031888:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788940849.031948:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788940849.031961:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788940849.031971:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788940849.031977:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788940849.031982:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03474e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788940849.032016:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940849.032022:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940849.032025:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940849.032028:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1788940849.032103:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940849.032111:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1788940849.032111:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944949248:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1788940849.032117:0:17885:0:(obd_config.c:1662:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788940849.032125:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788940849.032128:0:17885:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788940849.032130:0:17885:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788940849.032132:0:17885:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788940849.032134:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788940849.032138:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940849.032139:0:17885:0:(obd_config.c:1662:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788940849.032143:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788940849.032149:0:17885:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788940849.032153:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940849.032155:0:17885:0:(obd_config.c:1662:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788940849.032159:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788940849.032163:0:17885:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:3.0:1788940849.032187:0:17885:0:(obd_config.c:2073:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788940849.032191:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788940849.032208:0:17885:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff91cf0844b3b0) 00000020:00000080:3.0:1788940849.032232:0:17885:0:(obd_config.c:786:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000100:00100000:1.0:1788940849.032237:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944949760:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1788940849.032241:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1788940849.032375:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788940849.032698:0:17885:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788940849.032706:0:17885:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788940849.032713:0:17885:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9c34acc08bade3e6 00010000:00080000:3.0:1788940849.032752:0:17885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d02e8ea000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:3.0:1788940849.032975:0:17885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788940849.033039:0:17885:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788940849.033054:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1788940849.033660:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944949760 00000100:00100000:0.0:1788940849.033671:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944949760 00000100:00100000:0.0:1788940849.033723:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788940849.033745:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875839944949760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788940849.033783:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788940849.033860:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875839944949760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940849.033868:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940849.033930:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944949760:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788940849.036098:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940849.036372:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788940849.036515:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788940849.036956:0:17893:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788940849.036961:0:17893:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788940849.037862:0:17885:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788940849.037882:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788940849.037935:0:17885:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788940849.037964:0:17885:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08bade3ed 00000100:00080000:1.0:1788940849.037976:0:17885:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788940849.037984:0:17885:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91d02e8ea000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940849.038033:0:17885:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf079e8700 x1875839944949888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940849.038081:0:17885:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788940849.038164:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940849.038169:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940849.038172:0:17885:0:(obd_config.c:1662:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788940849.038175:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940849.038181:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940849.038187:0:17885:0:(obd_config.c:1662:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000100:00100000:0.0:1788940849.038189:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944949888:0@lo:8:llog_process_th.0 00000020:00000080:1.0:1788940849.038192:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788940849.038194:0:17885:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788940849.038197:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940849.038201:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940849.038205:0:17885:0:(obd_config.c:1662:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788940849.038215:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940849.038220:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940849.038223:0:17885:0:(obd_config.c:1662:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788940849.038229:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788940849.038367:0:17885:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940849.038372:0:17885:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000400:00000100:0.0:1788940849.038375:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839944949888 offset 0 length 520: 4 00000020:00000080:1.0:1788940849.038376:0:17885:0:(obd_config.c:1662:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788940849.038386:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:3.0:1788940849.038724:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940849.038738:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940849.038742:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940849.038745:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788940849.038940:0:17881:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788940849.038983:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788940849.039397:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602200/0x9c34acc08bade36f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade376 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940849.039414:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d004602200/0x9c34acc08bade36f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade376 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940849.040417:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d03547c000 from 1 10000000:01000000:1.0:1788940849.040428:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788940849.040554:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08bade3f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940849.040569:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08bade3f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940849.040583:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08bade3f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940849.040612:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944950016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940849.040713:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940849.040784:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02004f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940849.040864:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944950016 00000100:00100000:3.0:1788940849.040875:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944950016 00000100:00100000:3.0:1788940849.040942:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788940849.040953:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+15:17881:x1875839944950016:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940849.040969:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940849.040984:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d001218800/0x9c34acc08bade3fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade3f4 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.041015:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001218800/0x9c34acc08bade3fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade3f4 expref: 16 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.041028:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d001218800/0x9c34acc08bade3fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade3f4 expref: 16 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.041039:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001218800, rc 0) 00000100:00100000:3.0:1788940849.041093:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+16:17881:x1875839944950016:12345-0@lo:101:mount.lustre.0 Request processed in 141us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940849.041100:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788940849.041200:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944950016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940849.041230:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08bade3f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade3fb expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940849.041243:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08bade3f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade3fb expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940849.042007:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944950144:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788940849.042062:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940849.042160:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02004f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788940849.042438:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944950144 00000100:00100000:2.0:1788940849.042446:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944950144 00000100:00100000:2.0:1788940849.042591:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788940849.042601:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+16:17881:x1875839944950144:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788940849.042623:0:17143:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788940849.042646:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788940849.042650:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788940849.044751:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+16:17881:x1875839944950144:12345-0@lo:256:mount.lustre.0 Request processed in 2146us (2682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940849.044767:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788940849.044925:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944950144:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788940849.045767:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788940849.045829:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08bade3f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade3fb expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940849.045844:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08bade3f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade3fb expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940849.045855:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d03547c000 from 1 10000000:01000000:1.0:1788940849.045858:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940849.045901:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade402 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940849.045911:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade402 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940849.045922:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade402 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940849.045946:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944950272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940849.046004:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940849.046055:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02004f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788940849.047317:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944950272 00000100:00100000:0.0:1788940849.047334:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944950272 00000100:00100000:0.0:1788940849.047404:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788940849.047414:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+16:17881:x1875839944950272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940849.047431:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940849.047448:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584c400/0x9c34acc08bade409 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade402 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940849.047476:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584c400/0x9c34acc08bade409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade402 expref: 17 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940849.047488:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584c400/0x9c34acc08bade409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade402 expref: 17 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940849.047513:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c400, rc 0) 00000100:00100000:0.0:1788940849.047604:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17881:x1875839944950272:12345-0@lo:101:mount.lustre.0 Request processed in 191us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940849.047610:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788940849.047906:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944950272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940849.047945:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade402 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade409 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940849.047955:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade402 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade409 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940849.048109:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788940849.048148:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944950400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940849.048190:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940849.048232:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02004f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940849.048335:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944950400 00000100:00100000:3.0:1788940849.048341:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944950400 00000100:00100000:3.0:1788940849.048415:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788940849.048424:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17881:x1875839944950400:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940849.048516:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17881:x1875839944950400:12345-0@lo:501:mount.lustre.0 Request processed in 94us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940849.048521:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788940849.048604:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944950400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940849.048670:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944950528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940849.048739:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940849.048841:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0249ed3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940849.048884:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944950528 00000100:00100000:1.0:1788940849.048890:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944950528 00000100:00100000:1.0:1788940849.048921:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788940849.048929:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17881:x1875839944950528:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940849.049043:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17881:x1875839944950528:12345-0@lo:503:mount.lustre.0 Request processed in 115us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940849.049051:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788940849.049138:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944950528:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788940849.049568:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788940849.049650:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944950656:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940849.049690:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940849.049710:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940849.050479:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944950656 00000100:00100000:1.0:1788940849.050487:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944950656 00000100:00100000:1.0:1788940849.050519:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788940849.050527:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17881:x1875839944950656:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940849.050653:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17881:x1875839944950656:12345-0@lo:502:mount.lustre.0 Request processed in 126us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940849.050661:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788940849.050880:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944950656:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788940849.051079:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788940849.051111:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1788940849.051141:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1788940849.051158:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1788940849.051172:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1788940849.051186:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1788940849.051199:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1788940849.051211:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1788940849.051223:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788940849.051236:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1788940849.051250:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1788940849.052011:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944950784:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940849.052069:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940849.052103:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940849.054695:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944950784 00000100:00100000:2.0:1788940849.054718:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944950784 00000100:00100000:3.0:1788940849.057393:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788940849.057416:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17881:x1875839944950784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940849.057666:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17881:x1875839944950784:12345-0@lo:502:mount.lustre.0 Request processed in 259us (5596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940849.057676:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788940849.057785:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944950784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788940849.057906:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1788940849.057924:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788940849.062289:0:17895:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940849.062308:0:17895:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940849.062310:0:17895:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788940849.062321:0:17895:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d03547c000 00000020:00000080:2.0:1788940849.062325:0:17895:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788940849.062338:0:17895:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940849.062341:0:17895:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940849.062343:0:17895:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788940849.062347:0:17895:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940849.062350:0:17895:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940849.062352:0:17895:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788940849.062355:0:17895:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d03547c000 00000020:00000080:2.0:1788940849.062357:0:17895:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788940849.062433:0:17895:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940849.062437:0:17895:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940849.062439:0:17895:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788940849.062441:0:17895:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940849.062444:0:17895:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940849.062446:0:17895:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788940849.062463:0:17895:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d03547c000 00000020:00000080:2.0:1788940849.062465:0:17895:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788940849.062487:0:17895:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940849.062490:0:17895:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940849.062492:0:17895:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788940849.062495:0:17895:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940849.062498:0:17895:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940849.062499:0:17895:0:(obd_config.c:1662:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788940849.062503:0:17895:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d03547c000 00000020:00000080:3.0:1788940849.062564:0:17895:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788940849.062610:0:17895:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940849.062615:0:17895:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940849.062616:0:17895:0:(obd_config.c:1662:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788940849.062621:0:17895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1788940849.065874:0:17881:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788940849.065923:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788940849.065944:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade402 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade409 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940849.065958:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade402 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade409 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940849.066023:0:17881:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788940849.066026:0:17881:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91d03547c000 10000000:01000000:0.0:1788940849.066030:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91d03547c000 10000000:01000000:0.0:1788940849.066034:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788940849.066040:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91d03547c000 from 1 10000000:01000000:0.0:1788940849.066042:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788940849.066079:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08bade410 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940849.066088:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08bade410 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940849.066098:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08bade410 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940849.066121:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944950912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788940849.066205:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940849.066251:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940849.067481:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944950912 00000100:00100000:3.0:1788940849.067492:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944950912 00000100:00100000:3.0:1788940849.067544:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788940849.067555:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17881:x1875839944950912:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940849.067570:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940849.067585:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d001218c00/0x9c34acc08bade417 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade410 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.067628:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001218c00/0x9c34acc08bade417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade410 expref: 18 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.067640:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d001218c00/0x9c34acc08bade417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade410 expref: 18 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.067650:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001218c00, rc 0) 00000100:00100000:3.0:1788940849.067719:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17881:x1875839944950912:12345-0@lo:101:mount.lustre.0 Request processed in 166us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940849.067726:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788940849.067789:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944950912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940849.067804:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08bade410 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade417 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.067814:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08bade410 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade417 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788940849.070174:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788940849.074809:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940849.075080:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788940849.075116:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1788940849.075139:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1788940849.075165:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1788940849.075196:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1788940849.075217:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1788940849.075238:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1788940849.078693:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1788940849.078845:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1788940849.078877:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1788940849.078896:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1788940849.078911:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1788940849.078924:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1788940849.078939:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1788940849.078955:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1788940849.078974:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1788940849.078990:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1788940849.079006:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1788940849.079022:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1788940849.079043:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1788940849.079058:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1788940849.079072:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1788940849.079089:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1788940849.079127:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1788940849.079152:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1788940849.079174:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1788940849.079197:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1788940849.079216:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1788940849.079252:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1788940849.079299:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788940849.080829:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944951040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940849.080905:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940849.080951:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03ed2a480 going to sleep for 11 seconds 00000100:00100000:1.0:1788940849.081086:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944951040 00000100:00100000:1.0:1788940849.081094:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944951040 00000100:00100000:1.0:1788940849.081158:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788940849.081181:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17881:x1875839944951040:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940849.081422:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17881:x1875839944951040:12345-0@lo:501:mount.lustre.0 Request processed in 243us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940849.081432:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788940849.089916:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944951040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940849.089984:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944951168:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788940849.090069:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940849.090116:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03ed2a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788940849.090151:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944951168 00000100:00100000:0.0:1788940849.090173:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944951168 00000100:00100000:1.0:1788940849.090767:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788940849.090785:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17881:x1875839944951168:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940849.091010:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17881:x1875839944951168:12345-0@lo:503:mount.lustre.0 Request processed in 230us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940849.091020:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788940849.091402:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944951168:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788940849.093117:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788940849.093205:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944951296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940849.093296:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940849.093816:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944951296 00000100:00100000:3.0:1788940849.093825:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944951296 00000100:00100000:3.0:1788940849.093876:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788940849.093887:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17881:x1875839944951296:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940849.094004:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17881:x1875839944951296:12345-0@lo:502:mount.lustre.0 Request processed in 117us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940849.094014:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788940849.095386:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03ed2ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940849.095434:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944951296:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788940849.095850:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788940849.095892:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1788940849.095913:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1788940849.095932:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1788940849.095953:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1788940849.095972:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1788940849.095994:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1788940849.096011:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1788940849.096032:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1788940849.096052:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1788940849.096073:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1788940849.096094:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1788940849.096113:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1788940849.096129:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1788940849.096163:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1788940849.096178:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1788940849.096192:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1788940849.096204:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1788940849.096369:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1788940849.096384:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1788940849.096399:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1788940849.096412:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1788940849.096425:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1788940849.096441:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1788940849.096530:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1788940849.096552:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1788940849.096573:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1788940849.096591:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1788940849.096610:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1788940849.096629:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1788940849.096671:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1788940849.096689:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1788940849.096701:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1788940849.096715:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1788940849.096740:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1788940849.096757:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1788940849.096774:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1788940849.096789:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1788940849.096803:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1788940849.096816:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1788940849.096829:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1788940849.096844:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1788940849.096858:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1788940849.096871:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1788940849.096885:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1788940849.096898:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1788940849.096928:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1788940849.096948:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1788940849.097013:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944951424:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940849.097104:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940849.097168:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a4a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788940849.098875:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944951424 00000100:00100000:3.0:1788940849.098913:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944951424 00000100:00100000:3.0:1788940849.099000:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788940849.099011:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17881:x1875839944951424:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940849.099214:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17881:x1875839944951424:12345-0@lo:502:mount.lustre.0 Request processed in 205us (2110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940849.099223:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788940849.099311:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944951424:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788940849.112198:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1788940849.112287:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1788940849.112341:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944951552:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940849.112645:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940849.112711:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021ad99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940849.112783:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944951552 00000100:00100000:3.0:1788940849.112796:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944951552 00000100:00100000:3.0:1788940849.112873:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788940849.112885:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17881:x1875839944951552:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940849.113044:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17881:x1875839944951552:12345-0@lo:502:mount.lustre.0 Request processed in 159us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940849.113054:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788940849.114677:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944951552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788940849.114826:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1788940849.114845:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788940849.122132:0:17901:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788940849.122155:0:17901:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff91d00509cd88) 00000020:00000080:2.0:1788940849.122188:0:17901:0:(obd_config.c:786:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788940849.122391:0:17901:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d03547c000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788940849.122396:0:17901:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d03547c000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788940849.122399:0:17901:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d03547c000 3 00010000:00080000:2.0:1788940849.122439:0:17901:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d037879000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:3.0:1788940849.125454:0:17901:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788940849.125709:0:17901:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788940849.125789:0:17901:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788940849.125802:0:17901:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x9c34acc08bade425 00000100:00080000:3.0:1788940849.125817:0:17901:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788940849.125824:0:17901:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff91d037879000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940849.125866:0:17901:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d020c8e680 x1875839944951680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940849.125917:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875839944951680:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788940849.126017:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940849.126074:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944951680 00000100:00100000:0.0:1788940849.126089:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944951680 00000100:00080000:3.0:1788940849.126102:0:17901:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788940849.126147:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940849.126158:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1875839944951680:12345-0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788940849.126307:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940849.126314:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788940849.126317:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940849.126320:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1788940849.130211:0:17151:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 604 last 0 00000020:00000080:0.0:1788940849.130424:0:17151:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x9c34acc08bade42c 00000004:00100000:0.0:1788940849.130442:0:17151:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788940849.130766:0:17151:0:(import.c:65:import_set_state_nolock()) ffff91d02ebf6000 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1788940849.130889:0:17901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000100:00100000:0.0:1788940849.131741:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875839944951680:12345-0@lo:38:llog_process_th.0 Request processed in 5567us (5710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940849.131756:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1788940849.135507:0:17881:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788940849.135571:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788940849.135597:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08bade410 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade417 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940849.135622:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08bade410 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade417 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788940849.135685:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788940849.135687:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788940849.135689:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940849.135690:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940849.135692:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940849.135693:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940849.135695:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940849.135697:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940849.135698:0:17881:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788940849.135703:0:17881:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788940849.135705:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940849.135707:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788940849.135708:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940849.135709:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940849.135710:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940849.135711:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940849.135712:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940849.135714:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940849.135716:0:17881:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788940849.135767:0:17881:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788940849.135794:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944951808:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788940849.135895:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940849.135956:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a4a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940849.137014:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944951808 00000100:00100000:0.0:1788940849.137028:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944951808 00000100:00100000:0.0:1788940849.137085:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788940849.137094:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17881:x1875839944951808:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788940849.137377:0:17143:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788940849.137393:0:17143:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788940849.138215:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d020c8e680 x1875839944951680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940849.138230:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788940849.138238:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788940849.138247:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788940849.138253:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788940849.138282:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d037879000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788940849.138290:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875839944951680:0@lo:38:llog_process_th.0 00000001:00100000:2.0:1788940849.142636:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788940849.142774:0:17143:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788940849.142803:0:17143:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788940849.143124:0:17166:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788940849.143130:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788940849.143152:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d0355e7800/0x9c34acc08bade433 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940849.143172:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade330 expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940849.143192:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d001218800/0x9c34acc08bade3fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade3f4 expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940849.143200:0:17166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d0355e7800/0x9c34acc08bade433 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940849.143241:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d001218800/0x9c34acc08bade3fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08bade3f4 expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940849.143280:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d001218800/0x9c34acc08bade3fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08bade3f4 expref: 18 pid: 17145 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940849.143306:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875839944951936:0@lo:104: 00000100:00100000:2.0:1788940849.143370:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788940849.143430:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08bade330 expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940849.143439:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade337 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08bade330 expref: 18 pid: 17145 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940849.143448:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875839944952064:0@lo:104: 00000100:00100000:3.0:1788940849.143609:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944951936 00000100:00100000:3.0:1788940849.143618:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944951936 00000100:00100000:3.0:1788940849.143666:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940849.143676:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+3:17166:x1875839944951936:12345-0@lo:104: 00010000:00010000:3.0:1788940849.143690:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08bade3f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade3fb expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.143753:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940849.143766:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+3:17166:x1875839944951936:12345-0@lo:104: Request processed in 91us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940849.143773:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788940849.143796:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940849.143802:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08bade3f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade3fb expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.143810:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602e00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940849.143815:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08bade3f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08bade3fb expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.143824:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08bade3f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08bade3fb expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940849.143831:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08bade3f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08bade3fb expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940849.143838:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940849.143867:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08bade3f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade3fb expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.143873:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940849.143900:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08bade3f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade3fb expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.143907:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08bade3f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade3fb expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.143923:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940849.143925:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940849.143926:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940849.143954:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:303c4994-a6d4-4c7c-823f-eb7dad50725e:3646:1875839944952192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940849.143984:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940849.144031:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944952192 00000100:00100000:3.0:1788940849.144035:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944952192 00010000:00010000:3.0:1788940849.144174:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d001218800/0x9c34acc08bade3fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade3f4 expref: 19 pid: 17145 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940849.144199:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940849.144206:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+19:3646:x1875839944952192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940849.144217:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940849.144222:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d001218800/0x9c34acc08bade3fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade3f4 expref: 19 pid: 17145 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.144233:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d001218800/0x9c34acc08bade3fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08bade3f4 expref: 19 pid: 17145 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.144249:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940849.144297:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+19:3646:x1875839944952192:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940849.144304:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940849.144571:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:303c4994-a6d4-4c7c-823f-eb7dad50725e:3646:1875839944952192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940849.146919:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17881:x1875839944951808:12345-0@lo:253:mount.lustre.0 Request processed in 9819us (11021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940849.146934:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788940849.147581:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940849.147627:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a4aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940849.148135:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944952064 00000100:00100000:3.0:1788940849.148145:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944952064 00000100:00100000:3.0:1788940849.148192:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940849.148202:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+3:17166:x1875839944952064:12345-0@lo:104: 00010000:00010000:3.0:1788940849.148238:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d0355e7200/0x9c34acc08bade330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940849.148321:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:17881:1875839944951808:0@lo:253:mount.lustre.0 00010000:00010000:3.0:1788940849.148324:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940849.148333:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+3:17166:x1875839944952064:12345-0@lo:104: Request processed in 133us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940849.148340:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:01000000:0.0:1788940849.148341:0:17881:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788940849.148346:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788940849.148348:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788940849.148350:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940849.148352:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940849.148353:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940849.148361:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00010000:00010000:3.0:1788940849.148362:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:01000004:0.0:1788940849.148363:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788940849.148366:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940849.148369:0:17881:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:3.0:1788940849.148372:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0355e7200/0x9c34acc08bade330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.148381:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7200 already unused, calling callback (ffffffffc12d7c20) 00000020:02000000:0.0:1788940849.148386:0:17881:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 10000000:00010000:3.0:1788940849.148387:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e7200/0x9c34acc08bade330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08bade337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.148401:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0355e7200/0x9c34acc08bade330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08bade337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940849.148412:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e7200/0x9c34acc08bade330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08bade337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940849.148418:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940849.148457:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0355e7200/0x9c34acc08bade330 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.148464:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940849.148489:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0355e7200/0x9c34acc08bade330 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.148496:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0355e7200/0x9c34acc08bade330 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade337 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940849.148520:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940849.148522:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940849.148524:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940849.148549:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944952320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940849.148550:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d001218800/0x9c34acc08bade3fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08bade3f4 expref: 17 pid: 17145 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940849.148567:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875839944951936:0@lo:104: 00000100:00100000:2.0:1788940849.148580:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875839944952064:0@lo:104: 00010000:00010000:2.0:1788940849.148606:0:17166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d0355e7800/0x9c34acc08bade433 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940849.148763:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940849.148943:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944952320 00000100:00100000:2.0:1788940849.148949:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944952320 00010000:00010000:2.0:1788940849.148970:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade337 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade330 expref: 17 pid: 17145 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940849.149007:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940849.149013:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:3647:x1875839944952320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940849.149025:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940849.149030:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade337 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade330 expref: 17 pid: 17145 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940849.149042:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08bade330 expref: 17 pid: 17145 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940849.149056:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade337 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08bade330 expref: 17 pid: 17145 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940849.149070:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d0355e7800/0x9c34acc08bade433 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940849.149078:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0355e7800/0x9c34acc08bade433 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788940849.149099:0:17137:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005969160s 00010000:00010000:2.0:1788940849.149104:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d0355e7800/0x9c34acc08bade433 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940849.149112:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d0355e7800/0x9c34acc08bade433 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940849.149126:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d0355e7800/0x9c34acc08bade433 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940849.149132:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d0355e7800/0x9c34acc08bade433 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940849.149138:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940849.149142:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d0355e7800/0x9c34acc08bade433 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940849.149150:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d0355e7800/0x9c34acc08bade433 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940849.149171:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d0355e7800/0x9c34acc08bade433 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940849.149180:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940849.149214:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:303c4994-a6d4-4c7c-823f-eb7dad50725e+16:3647:x1875839944952320:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940849.149222:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788940849.149224:0:17166:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d0355e7800/0x9c34acc08bade433 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940849.149236:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d0355e7800/0x9c34acc08bade433 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940849.149250:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0355e7800/0x9c34acc08bade433 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940849.150307:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944952320:0@lo:103:ldlm_bl.0 00000040:01000000:3.0:1788940849.160595:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1788940849.161163:0:17907:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788940849.161516:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1788940849.161875:0:17907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788940849.164990:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788940849.165028:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1788940849.165533:0:17906:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788940849.165539:0:17906:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000004:00000080:2.0:1788940849.165739:0:17881:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788940849.165746:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788940849.165783:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940849.167785:0:17907:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788940849.167914:0:17907:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1788940849.168451:0:17908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17908:1875839944952448:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788940849.168631:0:17908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940849.168755:0:17908:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d035a3c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940849.168797:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944952448 00000100:00100000:0.0:1788940849.168806:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944952448 00000100:00100000:0.0:1788940849.169045:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788940849.169056:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17908:x1875839944952448:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788940849.169179:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17908:x1875839944952448:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 125us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940849.169188:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940849.169534:0:17908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17908:1875839944952448:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788940849.169569:0:17908:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788940849.169602:0:17908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17908:1875839944952576:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788940849.169636:0:17908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940849.169743:0:17908:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d035a3c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940849.169772:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944952576 00000100:00100000:0.0:1788940849.169777:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944952576 00000100:00100000:0.0:1788940849.169913:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788940849.169922:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17908:x1875839944952576:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788940849.170173:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17908:x1875839944952576:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 252us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940849.170180:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788940849.170230:0:17908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17908:1875839944952576:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788940849.170345:0:17908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17908:1875839944952704:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788940849.170373:0:17908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940849.170395:0:17908:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d035a3cf00 going to sleep for 11 seconds 00000040:00080000:2.0:1788940849.170912:0:17881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1788940849.171052:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944952704 00000100:00100000:2.0:1788940849.171058:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944952704 00000100:00100000:2.0:1788940849.171137:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940849.171147:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17908:x1875839944952704:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788940849.171218:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17908:x1875839944952704:12345-0@lo:900:lod0001_rec0000.0 Request processed in 73us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940849.171225:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788940849.172534:0:17908:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d020c8e680 x1875839944952704/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788940865 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940849.172550:0:17908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17908:1875839944952704:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788940849.172619:0:17908:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17908:1875839944952832:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788940849.172685:0:17908:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940849.172714:0:17908:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06f4e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788940849.173425:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944952832 00000100:00100000:1.0:1788940849.173433:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944952832 00000100:00100000:1.0:1788940849.173491:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940849.173500:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17908:x1875839944952832:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788940849.173584:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17908:x1875839944952832:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 86us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940849.173593:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940849.173628:0:17908:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17908:1875839944952832:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788940849.173686:0:17908:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940849.177748:0:17881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788940849.178396:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788940849.179142:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788940849.187546:0:17881:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:1.0:1788940849.191583:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788940849.191673:0:17908:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788940849.191678:0:17908:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:1.0:1788940849.198380:0:17881:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788940849.208865:0:17881:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788940849.208909:0:17881:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9d58415e7988 00100000:10000000:1.0:1788940849.208918:0:17881:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788940849.210607:0:17881:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788940849.210643:0:17881:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788940849.210660:0:17881:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788940849.210685:0:17881:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788940849.211604:0:17881:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788940849.211834:0:17881:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788940849.501242:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00010000:00010000:3.0:1788940850.011471:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940850.140423:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788940850.523534:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00010000:00010000:1.0:1788940851.038619:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788940851.099589:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788940851.099599:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d03547c000 from 8 10000000:01000000:0.0:1788940851.099604:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788940851.099658:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08bade43a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940851.099671:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08bade43a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940851.099683:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08bade43a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940851.099722:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944952960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940851.099797:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940851.099856:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940851.099915:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944952960 00000100:00100000:3.0:1788940851.099923:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944952960 00000100:00100000:3.0:1788940851.099981:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788940851.099992:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+16:17147:x1875839944952960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940851.100007:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940851.100021:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d001219a00/0x9c34acc08bade441 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade43a expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940851.100045:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001219a00/0x9c34acc08bade441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade43a expref: 17 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940851.100056:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d001219a00/0x9c34acc08bade441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade43a expref: 17 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940851.100065:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219a00, rc 0) 00000100:00100000:3.0:1788940851.100106:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17147:x1875839944952960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940851.100113:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788940851.100222:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944952960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940851.100240:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08bade43a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade441 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940851.100248:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08bade43a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade441 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940851.100399:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944953088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788940851.100507:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940851.100532:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a4aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940851.100596:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944953088 00000100:00100000:3.0:1788940851.100601:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944953088 00000100:00100000:3.0:1788940851.100632:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788940851.100639:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17147:x1875839944953088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788940851.100653:0:17143:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788940851.100668:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788940851.100672:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788940851.100764:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17147:x1875839944953088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940851.100771:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788940851.100845:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944953088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788940851.100893:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788940851.100901:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08bade43a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade441 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940851.100911:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08bade43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade441 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940851.100921:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788940851.100929:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91cf08ce7800 from 8 10000000:01000000:2.0:1788940851.100931:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788940851.100950:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e6400/0x9c34acc08bade448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940851.100957:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d0355e6400/0x9c34acc08bade448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940851.100966:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d0355e6400/0x9c34acc08bade448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940851.100979:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944953216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940851.101005:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940851.101036:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a4aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940851.101114:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944953216 00000100:00100000:0.0:1788940851.101119:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944953216 00000100:00100000:0.0:1788940851.101145:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788940851.101153:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17147:x1875839944953216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940851.101161:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940851.101171:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584c600/0x9c34acc08bade44f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade448 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940851.101189:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584c600/0x9c34acc08bade44f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade448 expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940851.101208:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584c600/0x9c34acc08bade44f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade448 expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940851.101215:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c600, rc 0) 00000100:00100000:0.0:1788940851.101250:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17147:x1875839944953216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940851.101356:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788940851.101745:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944953216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940851.101760:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d0355e6400/0x9c34acc08bade448 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade44f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940851.101768:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d0355e6400/0x9c34acc08bade448 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade44f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940851.101814:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944953344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788940851.101846:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940851.101868:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940851.101881:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944953344 00000100:00100000:0.0:1788940851.101885:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944953344 00000100:00100000:0.0:1788940851.101903:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788940851.101910:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17147:x1875839944953344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788940851.101922:0:17145:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788940851.101933:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788940851.101936:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788940851.102006:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17147:x1875839944953344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940851.102022:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788940851.102055:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944953344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788940851.102090:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788940851.102097:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e6400/0x9c34acc08bade448 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade44f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940851.102105:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d0355e6400/0x9c34acc08bade448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade44f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788940851.164328:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788940851.547362:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00010000:00010000:3.0:1788940852.070904:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940852.571359:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00010000:00010000:1.0:1788940853.084502:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940853.599235:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 0 seconds 00010000:00010000:3.0:1788940854.107573:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788940854.427490:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788940854.427498:0:15176:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788940854.427502:0:15176:0:(import.c:65:import_set_state_nolock()) ffff91d005e81000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940854.427514:0:15176:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff91d005e81000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940854.427544:0:15176:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf079eb100 x1875839944953600/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940854.427561:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940854.427565:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788940854.427568:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940854.427571:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788940854.427596:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940854.427599:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788940854.427602:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940854.427605:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788940854.427637:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944953984:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788940854.427713:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940854.427774:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788940854.427781:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944953472:0@lo:400:kworker.0 00000100:00100000:1.0:1788940854.427807:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940854.427826:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944954112:0@lo:400:kworker.0 00000100:00100000:1.0:1788940854.427853:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940854.427875:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944953728:0@lo:400:kworker.0 00000100:00100000:1.0:1788940854.427896:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940854.427912:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940854.427917:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944953856:0@lo:400:kworker.0 00000100:00100000:1.0:1788940854.427934:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940854.427963:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944954112 00000100:00100000:1.0:1788940854.427977:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944954112 00000100:00100000:1.0:1788940854.428013:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944953728 00000100:00100000:1.0:1788940854.428016:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944953728 00000100:00100000:1.0:1788940854.428030:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940854.428160:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944953984 00000100:00100000:2.0:1788940854.428165:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944953984 00000100:00100000:0.0:1788940854.428180:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944953600:0@lo:38:kworker.0 00000100:00100000:2.0:1788940854.428192:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944953856 00000100:00100000:2.0:1788940854.428195:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944953856 00000100:00100000:2.0:1788940854.428207:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940854.428209:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940854.428215:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1875839944953984:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940854.428236:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944953472 00000100:00100000:0.0:1788940854.428239:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944953472 00000004:00000024:2.0:1788940854.428251:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788940854.428298:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788940854.428304:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:3647:x1875839944953472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940854.428318:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1875839944953984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940854.428325:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940854.428332:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:3647:x1875839944953472:12345-0@lo:400:kworker.0 Request processed in 28us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940854.428337:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788940854.428339:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944953600 00000100:00100000:2.0:1788940854.428341:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944953600 00000100:00100000:2.0:1788940854.428350:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788940854.428355:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944953856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940854.428394:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944953856:12345-0@lo:400:kworker.0 Request processed in 39us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940854.428400:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788940854.428412:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788940854.428416:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1875839944953600:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788940854.428440:0:17890:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 609 last 0 00000100:00100000:1.0:1788940854.428457:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944954112:12345-0@lo:400:kworker.0 00000020:00000080:2.0:1788940854.428472:0:17890:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08bade456 00000004:00100000:2.0:1788940854.428485:0:17890:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788940854.428486:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944954112:12345-0@lo:400:kworker.0 Request processed in 31us (632us total) trans 0 rc 0/0 00000001:00000004:2.0:1788940854.428490:0:17890:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788940854.431146:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940854.431172:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944953728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940854.431457:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944953728:12345-0@lo:400:kworker.0 Request processed in 296us (3558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940854.431466:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788940854.434134:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788940854.434441:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944953856:0@lo:400:kworker.0 00010000:00080000:1.0:1788940854.434467:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91cf079eaa00 x1875839944953728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940854.434479:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944953728:0@lo:400:kworker.0 00000100:00100000:1.0:1788940854.434515:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944953472:0@lo:400:kworker.0 00010000:00080000:1.0:1788940854.434528:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91cf079ea300 x1875839944954112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940854.434536:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944954112:0@lo:400:kworker.0 00000100:00100000:1.0:1788940854.434553:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944953984:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788940854.442012:0:17890:0:(import.c:65:import_set_state_nolock()) ffff91cf07a18800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940854.442127:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875839944953600:12345-0@lo:38:kworker.0 Request processed in 13708us (13915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940854.442141:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788940854.444921:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788940854.444937:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788940854.444943:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788940854.444947:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d005e81000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788940854.444980:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000069163d17): req@ffff91d018b09180 x1875839944946304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940854.445001:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944953600:0@lo:38:kworker.0 00000100:00100000:0.0:1788940854.445104:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940854.445149:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0219cad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940854.445441:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944946304 00000100:00100000:1.0:1788940854.445448:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944946304 00000100:00100000:1.0:1788940854.445524:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788940854.445533:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17191:x1875839944946304:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788940854.445616:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17191:x1875839944946304:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 84us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940854.445623:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940854.447385:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944954240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788940854.447446:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940854.464440:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1875839944946304:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788940854.464496:0:17191:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788940854.464562:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1875839944954368:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788940854.464655:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940854.464712:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944954240 00000100:00100000:3.0:1788940854.464721:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944954240 00000100:00100000:3.0:1788940854.465431:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788940854.465443:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875839944954240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788940854.465479:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788940854.465545:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875839944954240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (18098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940854.465553:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788940854.470222:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940854.470379:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944954368 00000100:00100000:3.0:1788940854.470389:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944954368 00000100:00100000:2.0:1788940854.470439:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944954240:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788940854.470526:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788940854.470535:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17191:x1875839944954368:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788940854.470845:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17191:x1875839944954368:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 310us (6190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940854.470853:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788940854.470971:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1875839944954368:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788940854.471064:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1875839944954496:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788940854.471168:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940854.471222:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30600 going to sleep for 11 seconds 00000100:00100000:2.0:1788940854.488597:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944954496 00000100:00100000:2.0:1788940854.488612:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944954496 00000100:00100000:3.0:1788940854.488926:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788940854.488939:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17191:x1875839944954496:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788940854.490390:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17191:x1875839944954496:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 1447us (19214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940854.490402:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788940854.492139:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1875839944954496:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788940854.492212:0:17191:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940854.497209:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788940854.497333:0:17191:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:1.0:1788940854.497339:0:17191:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:3.0:1788940854.569732:0:18151:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788940855.133831:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788940855.421713:0:18203:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788940855.421945:0:18203:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1788940855.591241:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788940856.155507:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788940856.361827:0:18253:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788940856.362036:0:18253:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788940857.179808:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940857.499794:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940842/real 1788940842] req@ffff91cf079ead80 x1875839944947328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940857 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940857.499941:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91cf079ead80 x1875839944947328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940857 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940857.499956:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940842/real 1788940842] req@ffff91cf079eb480 x1875839944947456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940857 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940857.499970:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91cf079eb480 x1875839944947456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940857 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788940857.499993:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03ece2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788940857.500053:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788940857.500057:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944947328:0@lo:8:kworker.0 00000100:00080000:2.0:1788940857.500063:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03ed25000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940857.505311:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940857.505318:0:15176:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788940857.505322:0:15176:0:(import.c:65:import_set_state_nolock()) ffff91d03ece2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940857.505330:0:15176:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 597 00000100:00080000:3.0:1788940857.505336:0:15176:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788940857.505343:0:15176:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91d03ece2000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940857.505367:0:15176:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d020c8d180 x1875839944954880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788940857.505392:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940857.505395:0:15176:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788940857.505396:0:15176:0:(import.c:65:import_set_state_nolock()) ffff91d03ed25000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940857.505399:0:15176:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 597 00000100:00080000:3.0:1788940857.505402:0:15176:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788940857.505405:0:15176:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d03ed25000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940857.505419:0:15176:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d020c8ed80 x1875839944955008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788940857.505442:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940857.505446:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940857.505449:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940857.505452:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788940857.505487:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944955264:0@lo:400:kworker.0 00000100:00100000:3.0:1788940857.505556:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940857.505594:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788940857.505600:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944954624:0@lo:400:kworker.0 00000100:00100000:3.0:1788940857.505626:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940857.505662:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944955392:0@lo:400:kworker.0 00000100:00100000:3.0:1788940857.505689:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940857.505716:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944954752:0@lo:400:kworker.0 00000100:00100000:3.0:1788940857.505740:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940857.505757:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940857.505762:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944955136:0@lo:400:kworker.0 00000100:00100000:3.0:1788940857.505792:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940857.505827:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944955264 00000100:00100000:3.0:1788940857.505835:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944955264 00000100:00100000:3.0:1788940857.505877:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944954752 00000100:00100000:3.0:1788940857.505880:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944954752 00000100:00100000:3.0:1788940857.505898:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788940857.505907:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944955264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940857.505958:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944955264:12345-0@lo:400:kworker.0 Request processed in 51us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940857.505965:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788940857.505982:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788940857.505988:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875839944954752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940857.506019:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875839944954752:12345-0@lo:400:kworker.0 Request processed in 31us (279us total) trans 0 rc 0/0 00000100:00080000:2.0:1788940857.506373:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788940857.506379:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944947456:0@lo:8:kworker.0 00000100:00100000:2.0:1788940857.506405:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944954880:0@lo:8:kworker.0 00000400:00000100:2.0:1788940857.506436:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839944954880 offset 0 length 520: 4 00000100:00100000:2.0:1788940857.506454:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944955008:0@lo:8:kworker.0 00000400:00000100:2.0:1788940857.506473:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839944955008 offset 0 length 520: 4 00000100:00080000:1.0:1788940857.506537:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940857.506541:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788940857.506544:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940857.506547:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788940857.508864:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788940857.508920:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944954624 00000100:00100000:3.0:1788940857.508930:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944954624 00000100:00100000:3.0:1788940857.508983:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788940857.508992:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:3645:x1875839944954624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940857.509092:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:3645:x1875839944954624:12345-0@lo:400:kworker.0 Request processed in 101us (3464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940857.509098:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788940857.509132:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944955392 00000100:00100000:3.0:1788940857.509136:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944955392 00000100:00100000:3.0:1788940857.509166:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944955136 00000100:00100000:3.0:1788940857.509170:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944955136 00000100:00100000:3.0:1788940857.509181:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940857.509187:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944955392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940857.509346:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944955392:12345-0@lo:400:kworker.0 Request processed in 158us (3656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940857.509353:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940857.509365:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940857.509371:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944955136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940857.509400:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944955136:12345-0@lo:400:kworker.0 Request processed in 30us (3607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940857.509406:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940857.509455:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944954624:0@lo:400:kworker.0 00010000:00080000:3.0:1788940857.509471:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d020c8f480 x1875839944955392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940857.509483:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944955392:0@lo:400:kworker.0 00000100:00100000:3.0:1788940857.509496:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944955264:0@lo:400:kworker.0 00010000:00080000:3.0:1788940857.509539:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d020c8c700 x1875839944955136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940857.509548:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944955136:0@lo:400:kworker.0 00000100:00100000:3.0:1788940857.509558:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944954752:0@lo:400:kworker.0 00000020:00000080:1.0:1788940857.654134:0:18301:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe09f4db10 20000000:00000080:1.0:1788940857.654162:0:18301:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91d030c79800 uarg=0000000000000000 20000000:01000000:1.0:1788940857.654309:0:18301:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788940857.654317:0:18301:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788940857.654324:0:18301:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788940857.654783:0:18302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788940857.655018:0:18301:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788940857.662436:0:18301:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788940857.662477:0:18301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d004602000/0x9c34acc08bade45d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940857.662498:0:18301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d001218200/0x9c34acc08bade306 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade2ff expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940857.662506:0:18301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584c400/0x9c34acc08bade409 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade402 expref: 17 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940857.662537:0:18301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d004602000/0x9c34acc08bade45d lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940857.662596:0:18301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584c400/0x9c34acc08bade409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08bade402 expref: 17 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940857.662615:0:18301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584c400/0x9c34acc08bade409 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08bade402 expref: 17 pid: 17144 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940857.662633:0:18301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18301:1875839944955520:0@lo:104: 00000100:00100000:1.0:1788940857.662724:0:18301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940857.662787:0:18301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d001218200/0x9c34acc08bade306 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08bade2ff expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940857.662796:0:18301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d001218200/0x9c34acc08bade306 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08bade2ff expref: 17 pid: 17145 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940857.662805:0:18301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18301:1875839944955648:0@lo:104: 00000100:00100000:1.0:1788940857.662827:0:18301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940857.662924:0:18301:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02c241540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940857.663137:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944955520 00000100:00100000:2.0:1788940857.663148:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944955520 00000100:00100000:2.0:1788940857.663198:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944955648 00000100:00100000:2.0:1788940857.663202:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944955648 00000100:00100000:2.0:1788940857.663232:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940857.663244:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+4:18301:x1875839944955520:12345-0@lo:104: 00010000:00010000:2.0:1788940857.663593:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade402 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade409 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.663765:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940857.663773:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+4:18301:x1875839944955520:12345-0@lo:104: Request processed in 530us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940857.663780:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940857.663801:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940857.663817:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+3:18301:x1875839944955648:12345-0@lo:104: 00010000:00010000:3.0:1788940857.663826:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d03584ca00/0x9c34acc08bade2ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade306 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.663874:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788940857.663879:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+3:18301:x1875839944955648:12345-0@lo:104: Request processed in 65us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940857.663885:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788940857.663902:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940857.663909:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade402 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade409 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.663916:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602a00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940857.663921:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade402 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08bade409 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.663930:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08bade409 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940857.663937:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08bade409 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940857.663943:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788940857.663975:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade402 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade409 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.663982:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940857.664002:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade402 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade409 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664030:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade402 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade409 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664046:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940857.664049:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584ca00/0x9c34acc08bade2ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade306 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664055:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584ca00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940857.664059:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584ca00/0x9c34acc08bade2ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08bade306 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664066:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584ca00/0x9c34acc08bade2ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08bade306 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940857.664073:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584ca00/0x9c34acc08bade2ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08bade306 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940857.664078:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788940857.664096:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584ca00/0x9c34acc08bade2ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade306 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664101:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940857.664108:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584ca00/0x9c34acc08bade2ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade306 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664113:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584ca00/0x9c34acc08bade2ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade306 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664125:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940857.664134:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940857.664135:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940857.664157:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944955776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940857.664189:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940857.664226:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940857.664232:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944955904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940857.664252:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940857.664303:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944955776 00000100:00100000:3.0:1788940857.664308:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944955776 00010000:00010000:3.0:1788940857.664328:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584c400/0x9c34acc08bade409 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade402 expref: 18 pid: 17144 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940857.664349:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944955904 00000100:00100000:3.0:1788940857.664352:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944955904 00010000:00010000:3.0:1788940857.664362:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d001218200/0x9c34acc08bade306 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade2ff expref: 19 pid: 17145 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940857.664374:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940857.664379:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:303c4994-a6d4-4c7c-823f-eb7dad50725e+19:3647:x1875839944955776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940857.664389:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940857.664393:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584c400/0x9c34acc08bade409 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade402 expref: 19 pid: 17144 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664403:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584c400/0x9c34acc08bade409 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08bade402 expref: 19 pid: 17144 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664419:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940857.664447:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:303c4994-a6d4-4c7c-823f-eb7dad50725e+19:3647:x1875839944955776:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940857.664453:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940857.664473:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940857.664479:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034759500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:3647:x1875839944955904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940857.664486:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940857.664491:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d001218200/0x9c34acc08bade306 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade2ff expref: 18 pid: 17145 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664499:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d001218200/0x9c34acc08bade306 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08bade2ff expref: 18 pid: 17145 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664512:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d004602000/0x9c34acc08bade45d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664521:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d004602000/0x9c34acc08bade45d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664536:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d004602000/0x9c34acc08bade45d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664544:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d004602000/0x9c34acc08bade45d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664551:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d004602000/0x9c34acc08bade45d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664557:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d004602000/0x9c34acc08bade45d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664563:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602000 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940857.664567:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d004602000/0x9c34acc08bade45d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664575:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d004602000/0x9c34acc08bade45d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664590:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d004602000/0x9c34acc08bade45d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940857.664599:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940857.664624:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034759500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:3647:x1875839944955904:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940857.664631:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940857.664683:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944955904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940857.664699:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944955776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940857.664730:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940857.664895:0:18301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584c400/0x9c34acc08bade409 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08bade402 expref: 17 pid: 17144 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940857.664907:0:18301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18301:1875839944955520:0@lo:104: 00010000:00010000:1.0:1788940857.664919:0:18301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d001218200/0x9c34acc08bade306 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08bade2ff expref: 16 pid: 17145 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940857.664927:0:18301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18301:1875839944955648:0@lo:104: 00010000:00010000:1.0:1788940857.664960:0:18301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d004602000/0x9c34acc08bade45d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940857.664970:0:18301:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d004602000/0x9c34acc08bade45d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940857.664977:0:18301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d004602000/0x9c34acc08bade45d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940857.664984:0:18301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d004602000/0x9c34acc08bade45d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940858.203435:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940859.236529:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788940859.360764:0:17147:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788940859.360774:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d03547c000 from 13 10000000:01000000:2.0:1788940859.360782:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940859.360837:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e6a00/0x9c34acc08bade464 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940859.360852:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d0355e6a00/0x9c34acc08bade464 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940859.360865:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d0355e6a00/0x9c34acc08bade464 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940859.360894:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944956032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940859.360976:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940859.361015:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050ea6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940859.361078:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944956032 00000100:00100000:0.0:1788940859.361086:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944956032 00000100:00100000:0.0:1788940859.361153:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788940859.361163:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+16:17147:x1875839944956032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940859.361175:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940859.361210:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584d000/0x9c34acc08bade46b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade464 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940859.361234:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584d000/0x9c34acc08bade46b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade464 expref: 17 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940859.361245:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584d000/0x9c34acc08bade46b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade464 expref: 17 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940859.361253:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584d000, rc 0) 00000100:00100000:0.0:1788940859.361321:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17147:x1875839944956032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940859.361328:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788940859.362883:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944956032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940859.362905:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d0355e6a00/0x9c34acc08bade464 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade46b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940859.362918:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d0355e6a00/0x9c34acc08bade464 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade46b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940859.363003:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944956160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940859.363051:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940859.363105:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050ea6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940859.363187:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944956160 00000100:00100000:3.0:1788940859.363193:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944956160 00000100:00100000:3.0:1788940859.363238:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788940859.363247:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17147:x1875839944956160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940859.363410:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17147:x1875839944956160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940859.363418:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788940859.363573:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944956160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940859.363603:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944956288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940859.363653:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940859.363679:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050ea6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940859.363919:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944956288 00000100:00100000:0.0:1788940859.363925:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944956288 00000100:00100000:0.0:1788940859.363949:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788940859.363956:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17147:x1875839944956288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940859.364054:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17147:x1875839944956288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940859.364061:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788940859.364459:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944956288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788940859.365703:0:18371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788940859.365902:0:17147:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788940859.365937:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940859.365948:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e6a00/0x9c34acc08bade464 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade46b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940859.365961:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d0355e6a00/0x9c34acc08bade464 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade46b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940859.365972:0:17147:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788940859.365974:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91cf08ce7800 from 13 10000000:01000000:2.0:1788940859.365977:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940859.366012:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08bade472 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940859.366020:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08bade472 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940859.366031:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08bade472 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940859.366053:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944956416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940859.366104:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940859.366156:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050ea6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940859.366217:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944956416 00000100:00100000:0.0:1788940859.366224:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944956416 00000100:00100000:0.0:1788940859.366289:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788940859.366299:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+17:17147:x1875839944956416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940859.366313:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940859.366327:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584c000/0x9c34acc08bade479 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade472 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940859.366350:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584c000/0x9c34acc08bade479 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade472 expref: 18 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940859.366366:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584c000/0x9c34acc08bade479 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade472 expref: 18 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940859.366375:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c000, rc 0) 00000100:00100000:0.0:1788940859.366421:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17147:x1875839944956416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940859.366427:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788940859.366647:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944956416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940859.366663:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08bade472 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade479 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940859.366672:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08bade472 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade479 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940859.366724:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944956544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940859.366748:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940859.366776:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050ea6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940859.366836:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944956544 00000100:00100000:3.0:1788940859.366841:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944956544 00000100:00100000:3.0:1788940859.366874:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788940859.366882:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17147:x1875839944956544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940859.367006:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17147:x1875839944956544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940859.367013:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788940859.367156:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944956544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940859.367184:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944956672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940859.367235:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940859.367278:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050ea6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940859.367526:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944956672 00000100:00100000:1.0:1788940859.367532:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944956672 00000100:00100000:1.0:1788940859.367650:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788940859.367659:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17147:x1875839944956672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940859.367747:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:17147:x1875839944956672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940859.367754:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788940859.367831:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944956672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788940859.368507:0:18372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788940859.368561:0:17147:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788940859.368577:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940859.368586:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08bade472 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade479 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940859.368596:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08bade472 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade479 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940859.548977:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940849/real 1788940849] req@ffff91cf079e8700 x1875839944949888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940859 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940859.548989:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944956800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940859.549029:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91cf079e8700 x1875839944949888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940859 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940859.549042:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940849/real 1788940849] req@ffff91d018b0b480 x1875839944949632/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940859 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940859.549074:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d018b0b480 x1875839944949632/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940859 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788940859.549098:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02e8ea000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940859.549122:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788940859.549127:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944949888:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788940859.549133:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940859.549139:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788940859.549142:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944949632:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788940859.552428:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944956928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788940859.552601:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788940859.553735:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940859.553741:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788940859.553744:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940859.553747:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788940859.553760:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940859.553764:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788940859.553769:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940859.553776:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 604 00000100:00080000:2.0:1788940859.553784:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788940859.553792:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff91d02e8d2800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788940859.553819:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d018b09500 x1875839944957312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788940859.553838:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940859.553842:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788940859.553844:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d02e8ea000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940859.553848:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 604 00000100:00080000:2.0:1788940859.553852:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788940859.553855:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91d02e8ea000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788940859.553870:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d018b09f80 x1875839944957440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940859.553895:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944956800 00000100:00100000:0.0:1788940859.553909:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944956800 00000100:00100000:0.0:1788940859.554000:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788940859.554012:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944956800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788940859.554057:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788940859.554136:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944956800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940859.554144:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788940859.554714:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940859.554815:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940859.554830:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944957568:0@lo:400:kworker.0 00000100:00100000:3.0:1788940859.554871:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940859.554909:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944957056:0@lo:400:kworker.0 00000100:00100000:3.0:1788940859.554949:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940859.555048:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940859.555055:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944957184:0@lo:400:kworker.0 00000100:00100000:3.0:1788940859.555081:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940859.555195:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944956928 00000100:00100000:0.0:1788940859.555204:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944956928 00000100:00100000:0.0:1788940859.555238:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944957056 00000100:00100000:0.0:1788940859.555241:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944957056 00000100:00100000:0.0:1788940859.555254:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788940859.555282:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1875839944956928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788940859.555332:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788940859.555388:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1875839944956928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940859.555395:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788940859.555411:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788940859.555418:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875839944957056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940859.555451:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875839944957056:12345-0@lo:400:kworker.0 Request processed in 34us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940859.555458:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788940859.555640:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944957568 00000100:00100000:3.0:1788940859.555645:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944957568 00000100:00100000:3.0:1788940859.555687:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944957184 00000100:00100000:3.0:1788940859.555691:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944957184 00000100:00100000:3.0:1788940859.555706:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940859.555713:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944957568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940859.555748:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944957568:12345-0@lo:400:kworker.0 Request processed in 35us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940859.555754:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940859.555766:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788940859.555772:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944957184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940859.555799:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944957184:12345-0@lo:400:kworker.0 Request processed in 27us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940859.555806:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788940859.555854:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d018b0b800 x1875839944957184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940859.555870:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944957184:0@lo:400:kworker.0 00000100:00100000:3.0:1788940859.555900:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944957056:0@lo:400:kworker.0 00010000:00080000:3.0:1788940859.556399:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d018b08a80 x1875839944957568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940859.556411:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944957568:0@lo:400:kworker.0 00000100:00100000:3.0:1788940859.556431:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944956928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788940859.561473:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944957312:0@lo:8:kworker.0 00000400:00000100:3.0:1788940859.561558:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839944957312 offset 0 length 520: 4 00000100:00100000:3.0:1788940859.561614:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944957440:0@lo:8:kworker.0 00000400:00000100:3.0:1788940859.561648:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839944957440 offset 0 length 520: 4 00000100:00100000:3.0:1788940859.563430:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944956800:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788940860.251499:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788940860.578164:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788940861.275865:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788940861.404122:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788940862.299535:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940863.324120:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940864.358354:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940864.667480:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940864.667504:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944957696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788940864.667573:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940864.667651:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944957696 00000100:00100000:2.0:1788940864.667659:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944957696 00000100:00100000:2.0:1788940864.667721:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788940864.667730:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944957696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940864.667771:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788940864.667818:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944957696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940864.667825:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788940864.667876:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944957696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788940864.668107:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944957824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940864.668138:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940864.668187:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944957824 00000100:00100000:1.0:1788940864.668191:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944957824 00000100:00100000:1.0:1788940864.668215:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788940864.668222:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944957824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788940864.668243:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788940864.668304:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944957824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940864.668320:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788940864.668360:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944957824:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788940864.668655:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940864.668659:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940864.668662:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940864.668666:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940864.668679:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940864.668682:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940864.668696:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940864.668699:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788940864.668732:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944958208:0@lo:400:kworker.0 00000100:00100000:3.0:1788940864.668769:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940864.668792:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940864.668798:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944958080:0@lo:400:kworker.0 00000100:00100000:3.0:1788940864.668821:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940864.668845:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944958208 00000100:00100000:3.0:1788940864.668849:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944958208 00000100:00100000:3.0:1788940864.668882:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788940864.668890:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944958208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940864.668928:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944958208:12345-0@lo:400:kworker.0 Request processed in 38us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940864.668934:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788940864.669096:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d03475b480 x1875839944958208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940864.669109:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944958208:0@lo:400:kworker.0 00000100:00100000:3.0:1788940864.669127:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944958336:0@lo:400:kworker.0 00000100:00100000:3.0:1788940864.669213:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940864.669235:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788940864.669241:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944957952:0@lo:400:kworker.0 00000100:00100000:3.0:1788940864.669296:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940864.669322:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944958464:0@lo:400:kworker.0 00000100:00100000:3.0:1788940864.669344:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940864.669369:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944957952 00000100:00100000:3.0:1788940864.669373:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944957952 00000100:00100000:3.0:1788940864.669401:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788940864.669416:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:3647:x1875839944957952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940864.669455:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:3647:x1875839944957952:12345-0@lo:400:kworker.0 Request processed in 40us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940864.669461:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788940864.669484:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944958464 00000100:00100000:3.0:1788940864.669488:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944958464 00000100:00100000:3.0:1788940864.669506:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788940864.669511:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944958464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940864.669539:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944958464:12345-0@lo:400:kworker.0 Request processed in 28us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940864.669545:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788940864.669565:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944958080 00000100:00100000:3.0:1788940864.669568:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944958080 00000100:00100000:3.0:1788940864.669595:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944958336 00000100:00100000:3.0:1788940864.669598:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944958336 00000100:00100000:3.0:1788940864.669610:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788940864.669615:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944958080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940864.669649:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944958080:12345-0@lo:400:kworker.0 Request processed in 33us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940864.669655:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788940864.669667:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940864.669672:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944958336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940864.669901:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944958336:12345-0@lo:400:kworker.0 Request processed in 228us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940864.669908:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940864.669935:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944958080:0@lo:400:kworker.0 00000100:00100000:3.0:1788940864.670044:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944957952:0@lo:400:kworker.0 00010000:00080000:3.0:1788940864.670058:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d03475b100 x1875839944958464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940864.670068:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944958464:0@lo:400:kworker.0 00000100:00100000:3.0:1788940864.670077:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944958336:0@lo:400:kworker.0 00000020:01000004:1.0:1788940865.116252:0:18663:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788940865.116323:0:18663:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788940865.116325:0:18663:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788940865.116445:0:18663:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91cf08456000 00000020:01000004:1.0:1788940865.116460:0:18663:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788940865.116474:0:18663:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788940865.116488:0:18663:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osd (ffff91cf06cdb3b0) 00000020:00000080:1.0:1788940865.116505:0:18663:0:(obd_config.c:786:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788940865.151539:0:18663:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788940865.154208:0:18663:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788940865.154730:0:18663:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788940865.154950:0:18663:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788940865.155227:0:18663:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788940865.155477:0:18663:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788940865.155690:0:18663:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1788940865.156552:0:18663:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788940865.156802:0:18663:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788940865.156817:0:18663:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788940865.156831:0:18663:0:(genops.c:1393:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9c34acc08bade487 00000020:01000004:2.0:1788940865.156839:0:18663:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788940865.156863:0:18663:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788940865.156867:0:18663:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788940865.156874:0:18663:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788940865.156887:0:18663:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788940865.156900:0:18663:0:(genops.c:415:class_newdev()) Allocate new device OSS (ffff91d005098000) 00000020:00000080:2.0:1788940865.156913:0:18663:0:(obd_config.c:786:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788940865.160388:0:18663:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940865.163530:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788940865.163547:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788940865.164089:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788940865.164096:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788940865.164500:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788940865.164511:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788940865.166071:0:18663:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940865.166296:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788940865.166303:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788940865.169637:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788940865.169653:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788940865.191209:0:18663:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940865.191706:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788940865.191712:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788940865.193052:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788940865.193075:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788940865.194685:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788940865.194699:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788940865.196909:0:18663:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940865.197158:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788940865.197166:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788940865.197843:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788940865.197849:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788940865.282252:0:18663:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940865.282598:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788940865.282606:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788940865.284241:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788940865.285316:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788940865.285923:0:18663:0:(obd_config.c:900:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788940865.285963:0:18663:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788940865.285970:0:18663:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788940865.310246:0:18663:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788940865.310645:0:18663:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.125@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788940865.310651:0:18663:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788940865.310652:0:18663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788940865.310654:0:18663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940865.310655:0:18663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940865.310657:0:18663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940865.310658:0:18663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940865.310660:0:18663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788940865.310662:0:18663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940865.310663:0:18663:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788940865.310667:0:18663:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788940865.310669:0:18663:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788940865.310671:0:18663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788940865.310672:0:18663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940865.310673:0:18663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940865.310674:0:18663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940865.310676:0:18663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940865.310677:0:18663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788940865.310678:0:18663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940865.310746:0:18663:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788940865.310788:0:18663:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788940865.310810:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944958592:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788940865.310881:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940865.311064:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb88000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940865.311110:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944958592 00000100:00100000:0.0:1788940865.311233:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944958592 00000100:00100000:0.0:1788940865.311538:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788940865.311550:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:18663:x1875839944958592:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788940865.311603:0:17143:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788940865.311606:0:17143:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788940865.311610:0:17143:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788940865.312000:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:18663:x1875839944958592:12345-0@lo:253:mount.lustre.0 Request processed in 452us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940865.312010:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788940865.312102:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944958592:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788940865.312126:0:18663:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788940865.312129:0:18663:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788940865.312131:0:18663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788940865.312132:0:18663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940865.312133:0:18663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940865.312140:0:18663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940865.312142:0:18663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940865.312143:0:18663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788940865.312145:0:18663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940865.312146:0:18663:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788940865.312166:0:18663:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91cf08456000 from lustre-OST0000 10000000:01000000:1.0:1788940865.312198:0:18663:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788940865.312201:0:18663:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788940865.312217:0:18663:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91cf07a04d88 local copy 00010000:00010000:1.0:1788940865.312228:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade249 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940865.312361:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944958720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940865.312395:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940865.313121:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0029a0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788940865.313317:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944958720 00000100:00100000:3.0:1788940865.313333:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944958720 00000100:00100000:3.0:1788940865.313365:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788940865.313372:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:18663:x1875839944958720:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940865.313444:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:18663:x1875839944958720:12345-0@lo:501:mount.lustre.0 Request processed in 72us (1048us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788940865.313451:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788940865.313588:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944958720:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788940865.313603:0:18663:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788940865.313620:0:18663:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788940865.313627:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade249 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940865.313636:0:18663:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade249 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940865.313664:0:18663:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91cf08456000 10000000:01000000:1.0:1788940865.313668:0:18663:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788940865.313673:0:18663:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788940865.313675:0:18663:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788940865.313689:0:18663:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788940865.313692:0:18663:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788940865.313713:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade495 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940865.313721:0:18663:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade495 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940865.313730:0:18663:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade495 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940865.313749:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944958848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940865.313781:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940865.313800:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0029a0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788940865.313904:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944958848 00000100:00100000:3.0:1788940865.313909:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944958848 00000100:00100000:3.0:1788940865.313926:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788940865.313932:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+18:18663:x1875839944958848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940865.313950:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940865.313962:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d001219600/0x9c34acc08bade49c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade495 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940865.313981:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001219600/0x9c34acc08bade49c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade495 expref: 19 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940865.313991:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d001219600/0x9c34acc08bade49c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade495 expref: 19 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940865.314000:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219600, rc 0) 00000100:00100000:3.0:1788940865.314026:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+19:18663:x1875839944958848:12345-0@lo:101:mount.lustre.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940865.314031:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788940865.314333:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944958848:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940865.314345:0:18663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade495 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade49c expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940865.314354:0:18663:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade495 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade49c expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940865.315378:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788940865.316096:0:18663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940865.318571:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788940865.318634:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788940865.318647:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788940865.318658:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788940865.318668:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788940865.318694:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788940865.318722:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788940865.318727:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788940865.318854:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944958976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940865.318930:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940865.319106:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d018b46240 going to sleep for 11 seconds 00000100:00100000:0.0:1788940865.319326:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944958976 00000100:00100000:0.0:1788940865.319336:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944958976 00000100:00100000:0.0:1788940865.319394:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788940865.319404:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d010d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+19:18663:x1875839944958976:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940865.319560:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d010d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+19:18663:x1875839944958976:12345-0@lo:501:mount.lustre.0 Request processed in 158us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940865.319569:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788940865.319808:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944958976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940865.319843:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944959104:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940865.319885:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940865.319909:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d018b46240 going to sleep for 11 seconds 00000100:00100000:0.0:1788940865.320026:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944959104 00000100:00100000:0.0:1788940865.320031:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944959104 00000100:00100000:0.0:1788940865.320061:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788940865.320068:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+19:18663:x1875839944959104:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940865.320953:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+19:18663:x1875839944959104:12345-0@lo:503:mount.lustre.0 Request processed in 881us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940865.320961:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788940865.321494:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944959104:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788940865.322113:0:18663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788940865.322452:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944959232:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940865.322511:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940865.322614:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0029a0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788940865.322655:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944959232 00000100:00100000:0.0:1788940865.322662:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944959232 00000100:00100000:0.0:1788940865.322817:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788940865.322828:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+19:18663:x1875839944959232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940865.323380:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+19:18663:x1875839944959232:12345-0@lo:502:mount.lustre.0 Request processed in 553us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940865.323389:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788940865.323494:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944959232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788940865.323812:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788940865.323842:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788940865.323855:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788940865.323868:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788940865.323881:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788940865.323892:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788940865.323906:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788940865.323918:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788940865.323930:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788940865.323956:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788940865.323970:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788940865.323982:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788940865.324009:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944959360:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940865.324049:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940865.324448:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d018b46240 going to sleep for 11 seconds 00000100:00100000:3.0:1788940865.324558:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944959360 00000100:00100000:3.0:1788940865.324566:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944959360 00000100:00100000:3.0:1788940865.324610:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788940865.324617:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08583c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+19:18663:x1875839944959360:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940865.324810:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08583c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+19:18663:x1875839944959360:12345-0@lo:502:mount.lustre.0 Request processed in 193us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940865.324818:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788940865.324905:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944959360:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788940865.324974:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788940865.324983:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788940865.326107:0:18680:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788940865.326127:0:18680:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788940865.326135:0:18680:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940865.326281:0:18680:0:(obd_config.c:1662:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788940865.326289:0:18680:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788940865.326366:0:18680:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000 (ffff91cf06cd99d8) 00000020:00000080:1.0:1788940865.326393:0:18680:0:(obd_config.c:786:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788940865.326401:0:18680:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788940865.326481:0:18680:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91cf08456000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788940865.326489:0:18680:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788940865.326496:0:18680:0:(genops.c:1393:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9c34acc08bade4aa 00010000:00010000:1.0:1788940865.332549:0:18680:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788940865.333885:0:18680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1788940865.336838:0:18680:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788940865.339660:0:18680:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788940865.339673:0:18680:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940865.339746:0:18680:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940865.339749:0:18680:0:(obd_config.c:1662:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788940865.339754:0:18680:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788940865.339814:0:18680:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788940865.339816:0:18680:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788940865.339818:0:18680:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788940865.339821:0:18680:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788940865.339825:0:18680:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940865.339827:0:18680:0:(obd_config.c:1662:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788940865.339830:0:18680:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940865.339833:0:18680:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940865.339835:0:18680:0:(obd_config.c:1662:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788940865.339838:0:18680:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788940865.339840:0:18680:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788940865.339843:0:18680:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940865.339845:0:18680:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940865.339846:0:18680:0:(obd_config.c:1662:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788940865.339849:0:18680:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940865.339852:0:18680:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940865.339853:0:18680:0:(obd_config.c:1662:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788940865.339856:0:18680:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788940865.339889:0:18680:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940865.339892:0:18680:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940865.339894:0:18680:0:(obd_config.c:1662:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788940865.339897:0:18680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788940865.343492:0:18663:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788940865.343538:0:18663:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788940865.343559:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade495 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade49c expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940865.343572:0:18663:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade495 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade49c expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940865.343591:0:18663:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91cf08456000 from 1 10000000:01000000:3.0:1788940865.343594:0:18663:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788940865.343632:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d001219c00/0x9c34acc08bade4b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940865.343641:0:18663:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d001219c00/0x9c34acc08bade4b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940865.343653:0:18663:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d001219c00/0x9c34acc08bade4b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940865.343688:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944959488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788940865.343754:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940865.343808:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944959488 00000100:00100000:3.0:1788940865.343814:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944959488 00000100:00100000:3.0:1788940865.343855:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788940865.343874:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+19:18663:x1875839944959488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940865.343898:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940865.343911:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d001219200/0x9c34acc08bade4b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade4b1 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940865.343944:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001219200/0x9c34acc08bade4b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade4b1 expref: 20 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940865.343956:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d001219200/0x9c34acc08bade4b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade4b1 expref: 20 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940865.343964:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219200, rc 0) 00000100:00100000:3.0:1788940865.343997:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:18663:x1875839944959488:12345-0@lo:101:mount.lustre.0 Request processed in 133us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940865.344003:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788940865.344043:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb88600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940865.344064:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944959488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940865.344077:0:18663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d001219c00/0x9c34acc08bade4b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade4b8 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940865.344086:0:18663:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d001219c00/0x9c34acc08bade4b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade4b8 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788940865.346011:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788940865.346529:0:18663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940865.346735:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788940865.346880:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788940865.346902:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788940865.346907:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788940865.347742:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944959616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940865.347875:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940865.347919:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb88000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940865.348019:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944959616 00000100:00100000:2.0:1788940865.348027:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944959616 00000100:00100000:2.0:1788940865.348080:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788940865.348088:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08583450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:18663:x1875839944959616:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940865.348409:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08583450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:18663:x1875839944959616:12345-0@lo:501:mount.lustre.0 Request processed in 320us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940865.348416:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788940865.348519:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944959616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940865.348551:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944959744:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788940865.348611:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940865.348656:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb88000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940865.357607:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944959744 00000100:00100000:0.0:1788940865.357625:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944959744 00000100:00100000:0.0:1788940865.357693:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788940865.357704:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:18663:x1875839944959744:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940865.358396:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:18663:x1875839944959744:12345-0@lo:503:mount.lustre.0 Request processed in 692us (9781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940865.358405:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788940865.359828:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944959744:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788940865.360702:0:18663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788940865.361085:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944959872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940865.361165:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940865.361203:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb88600 going to sleep for 11 seconds 00000100:00100000:2.0:1788940865.361504:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944959872 00000100:00100000:2.0:1788940865.361513:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944959872 00000100:00100000:2.0:1788940865.361560:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788940865.361569:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:18663:x1875839944959872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940865.361694:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:18663:x1875839944959872:12345-0@lo:502:mount.lustre.0 Request processed in 125us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940865.361702:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788940865.362077:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944959872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788940865.363136:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788940865.363180:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788940865.363195:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788940865.363207:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788940865.363219:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788940865.363232:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788940865.363245:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788940865.364064:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788940865.364100:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788940865.364111:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788940865.364122:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788940865.364173:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944960000:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940865.364253:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940865.364903:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0196ea0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940865.366236:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944960000 00000100:00100000:2.0:1788940865.366247:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944960000 00000100:00100000:2.0:1788940865.366543:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788940865.366554:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08583050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:18663:x1875839944960000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940865.366747:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08583050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:18663:x1875839944960000:12345-0@lo:502:mount.lustre.0 Request processed in 194us (2492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940865.366755:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788940865.366856:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944960000:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788940865.366960:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788940865.366975:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788940865.368022:0:18684:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940865.368033:0:18684:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940865.368035:0:18684:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788940865.368041:0:18684:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91cf08456000 00000020:00000080:0.0:1788940865.368043:0:18684:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788940865.368052:0:18684:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940865.368054:0:18684:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940865.368055:0:18684:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788940865.368057:0:18684:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940865.368059:0:18684:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940865.368060:0:18684:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788940865.368062:0:18684:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91cf08456000 00000020:00000080:0.0:1788940865.368064:0:18684:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788940865.368148:0:18684:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940865.368153:0:18684:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940865.368154:0:18684:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788940865.368156:0:18684:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940865.368159:0:18684:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940865.368160:0:18684:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788940865.368164:0:18684:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91cf08456000 00000020:00000080:0.0:1788940865.368166:0:18684:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788940865.368185:0:18684:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940865.368189:0:18684:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940865.368190:0:18684:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788940865.368192:0:18684:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940865.368194:0:18684:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940865.368195:0:18684:0:(obd_config.c:1662:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788940865.368198:0:18684:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91cf08456000 00000020:00000080:0.0:1788940865.368200:0:18684:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788940865.368219:0:18684:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940865.368221:0:18684:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940865.368223:0:18684:0:(obd_config.c:1662:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788940865.368225:0:18684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1788940865.368337:0:18663:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788940865.368359:0:18663:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788940865.368377:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d001219c00/0x9c34acc08bade4b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade4b8 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.368388:0:18663:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d001219c00/0x9c34acc08bade4b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade4b8 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940865.368435:0:18663:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788940865.368438:0:18663:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91cf08456000 10000000:01000000:0.0:1788940865.368440:0:18663:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91cf08456000 10000000:01000000:0.0:1788940865.368444:0:18663:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788940865.368449:0:18663:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91cf08456000 from 1 10000000:01000000:0.0:1788940865.368457:0:18663:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788940865.368490:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08bade4bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.368500:0:18663:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08bade4bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.368512:0:18663:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08bade4bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940865.368535:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944960128:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788940865.368600:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788940865.372965:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940865.372990:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0196ea540 going to sleep for 11 seconds 00000100:00100000:3.0:1788940865.373079:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944960128 00000100:00100000:3.0:1788940865.373090:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944960128 00000100:00100000:3.0:1788940865.373281:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788940865.373293:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:18663:x1875839944960128:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940865.373310:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940865.373327:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d001219000/0x9c34acc08bade4c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade4bf expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940865.373357:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001219000/0x9c34acc08bade4c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade4bf expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940865.373369:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d001219000/0x9c34acc08bade4c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade4bf expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940865.373378:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219000, rc 0) 00000100:00100000:3.0:1788940865.373448:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:18663:x1875839944960128:12345-0@lo:101:mount.lustre.0 Request processed in 157us (4847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940865.373465:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788940865.373811:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944960128:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940865.373830:0:18663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08bade4bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade4c6 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.373840:0:18663:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08bade4bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade4c6 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788940865.375317:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788940865.375575:0:18663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940865.382313:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788940865.382390:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788940865.382407:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788940865.382421:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788940865.382435:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788940865.382447:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788940865.382460:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788940865.382483:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788940865.382497:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788940865.382509:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788940865.382522:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788940865.382534:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788940865.382547:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788940865.382559:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788940865.382570:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788940865.382597:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788940865.382612:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788940865.382637:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788940865.382651:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788940865.382664:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788940865.382677:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788940865.384658:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788940865.384675:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788940865.385286:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788940865.385307:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788940865.385321:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788940865.385332:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788940865.385345:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788940865.385357:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788940865.385370:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788940865.385382:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788940865.385395:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788940865.385408:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788940865.385437:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788940865.385452:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788940865.385465:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788940865.385478:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788940865.385505:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788940865.385510:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788940865.385630:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944960256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940865.388104:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940865.388228:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0196ea480 going to sleep for 11 seconds 00000100:00100000:3.0:1788940865.388903:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944960256 00000100:00100000:3.0:1788940865.388913:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944960256 00000100:00100000:3.0:1788940865.389039:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788940865.389051:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:18663:x1875839944960256:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940865.389318:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:18663:x1875839944960256:12345-0@lo:501:mount.lustre.0 Request processed in 269us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940865.389326:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788940865.390796:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944960256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940865.390858:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944960384:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940865.390930:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940865.391421:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0196ea480 going to sleep for 11 seconds 00000100:00100000:2.0:1788940865.392789:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944960384 00000100:00100000:2.0:1788940865.392801:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944960384 00000100:00100000:2.0:1788940865.392860:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788940865.392871:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:18663:x1875839944960384:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940865.393033:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:18663:x1875839944960384:12345-0@lo:503:mount.lustre.0 Request processed in 164us (2102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940865.393041:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788940865.393845:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944960384:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788940865.394408:0:18663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788940865.394492:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944960512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940865.394544:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940865.394595:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0196ea540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940865.394981:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944960512 00000100:00100000:2.0:1788940865.394989:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944960512 00000100:00100000:2.0:1788940865.395040:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788940865.395050:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:18663:x1875839944960512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940865.395322:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:18663:x1875839944960512:12345-0@lo:502:mount.lustre.0 Request processed in 274us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940865.395330:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788940865.396881:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944960512:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788940865.397797:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788940865.397840:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788940865.397856:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788940865.397869:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788940865.397881:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788940865.397893:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788940865.397907:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788940865.397920:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788940865.397947:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788940865.397980:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788940865.397997:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788940865.398012:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788940865.398024:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788940865.398035:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788940865.398047:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788940865.398070:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788940865.398085:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788940865.398098:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788940865.398110:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788940865.398368:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788940865.398392:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788940865.398406:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788940865.398419:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788940865.398433:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788940865.398446:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788940865.398474:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788940865.398489:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788940865.398502:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788940865.398514:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788940865.398527:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788940865.398539:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788940865.398551:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788940865.398564:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788940865.398587:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788940865.398604:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788940865.398617:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788940865.398630:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788940865.398643:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788940865.398656:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788940865.398668:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788940865.399011:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788940865.399045:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788940865.399061:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788940865.399075:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788940865.399089:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788940865.399102:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788940865.399331:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788940865.399352:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788940865.399426:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944960640:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940865.399507:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940865.401299:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0196ea540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940865.406620:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944960640 00000100:00100000:2.0:1788940865.406636:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944960640 00000100:00100000:2.0:1788940865.406699:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788940865.406709:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:18663:x1875839944960640:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940865.406880:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:18663:x1875839944960640:12345-0@lo:502:mount.lustre.0 Request processed in 172us (7372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940865.406888:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788940865.408898:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944960640:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788940865.409238:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788940865.409288:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788940865.409333:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944960768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940865.409399:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940865.409435:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050eab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940865.409456:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944960768 00000100:00100000:2.0:1788940865.409463:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944960768 00000100:00100000:2.0:1788940865.409503:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788940865.409512:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:18663:x1875839944960768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940865.409621:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:18663:x1875839944960768:12345-0@lo:502:mount.lustre.0 Request processed in 108us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940865.409629:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788940865.409907:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944960768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788940865.409971:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788940865.409978:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788940865.410612:0:18689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788940865.410638:0:18689:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91cf063233b0) 00000020:00000080:2.0:1788940865.410662:0:18689:0:(obd_config.c:786:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788940865.410877:0:18689:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91cf08456000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788940865.410882:0:18689:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91cf08456000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788940865.410884:0:18689:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91cf08456000 3 00010000:00080000:2.0:1788940865.410915:0:18689:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d0065a4800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.125@tcp at head 00010000:00010000:2.0:1788940865.417124:0:18689:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788940865.420471:0:18689:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788940865.420526:0:18689:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788940865.420542:0:18689:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9c34acc08bade4d4 00000100:00080000:3.0:1788940865.420553:0:18689:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788940865.420560:0:18689:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91d0065a4800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940865.420607:0:18689:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d034759180 x1875839944960896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788940865.420632:0:18689:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788940865.421309:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940865.421314:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940865.421318:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940865.421321:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940865.421325:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940865.421328:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940865.421331:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940865.421345:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788940865.421375:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875839944960896:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788940865.421442:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940865.421500:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944960896 00000100:00100000:3.0:1788940865.421508:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944960896 00000100:00100000:3.0:1788940865.421538:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940865.421546:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1875839944960896:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788940865.421569:0:17151:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 620 last 0 00000020:00000080:3.0:1788940865.421612:0:17151:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9c34acc08bade4db 00000004:00100000:3.0:1788940865.421629:0:17151:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788940865.421662:0:17151:0:(import.c:65:import_set_state_nolock()) ffff91cf08f39800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940865.423764:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875839944960896:12345-0@lo:38:llog_process_th.0 Request processed in 1590us (1694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940865.423778:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788940865.424383:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d034759180 x1875839944960896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940865.424397:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788940865.424409:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788940865.424418:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788940865.424422:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788940865.424426:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d0065a4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788940865.424434:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875839944960896:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1788940865.426878:0:18689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788940865.426896:0:18689:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff91cf063219d8) 00000020:00000080:2.0:1788940865.426925:0:18689:0:(obd_config.c:786:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788940865.427034:0:18689:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91cf08456000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788940865.427038:0:18689:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91cf08456000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788940865.427041:0:18689:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91cf08456000 3 00010000:00080000:2.0:1788940865.427072:0:18689:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91cf06329800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.125@tcp at head 00010000:00010000:2.0:1788940865.430654:0:18689:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788940865.430887:0:18689:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788940865.430937:0:18689:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788940865.430953:0:18689:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x9c34acc08bade4e9 00000100:00080000:2.0:1788940865.430964:0:18689:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788940865.430970:0:18689:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff91cf06329800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788940865.431005:0:18689:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d018b09880 x1875839944961024/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788940865.431025:0:18689:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788940865.431411:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875839944961024:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788940865.431484:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940865.431548:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944961024 00000100:00100000:0.0:1788940865.431556:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944961024 00000100:00100000:0.0:1788940865.431598:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940865.431605:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875839944961024:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788940865.431630:0:17150:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 620 last 0 00000020:00000080:0.0:1788940865.431673:0:17150:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x9c34acc08bade4f0 00000004:00100000:0.0:1788940865.431687:0:17150:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788940865.431718:0:17150:0:(import.c:65:import_set_state_nolock()) ffff91d020fb2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940865.431767:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875839944961024:12345-0@lo:38:llog_process_th.0 Request processed in 160us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940865.431774:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788940865.431811:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d018b09880 x1875839944961024/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940865.431827:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788940865.431835:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788940865.431841:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788940865.431846:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788940865.431849:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf06329800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788940865.431855:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875839944961024:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788940865.435422:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940865.435431:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940865.435434:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940865.435437:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940865.435441:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940865.435444:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940865.435447:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940865.435449:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788940865.437453:0:18689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788940865.437504:0:18663:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788940865.437541:0:18663:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788940865.437556:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08bade4bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade4c6 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940865.437567:0:18663:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08bade4bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade4c6 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788940865.437625:0:18663:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788940865.437628:0:18663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788940865.437629:0:18663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940865.437630:0:18663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940865.437631:0:18663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940865.437632:0:18663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940865.437634:0:18663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940865.437636:0:18663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940865.437637:0:18663:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788940865.437641:0:18663:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788940865.437643:0:18663:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940865.437645:0:18663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788940865.437646:0:18663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940865.437647:0:18663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940865.437648:0:18663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940865.437649:0:18663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940865.437650:0:18663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940865.437650:0:18663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940865.437651:0:18663:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788940865.437677:0:18663:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788940865.437696:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944961152:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788940865.437761:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940865.437792:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050ea900 going to sleep for 11 seconds 00000100:00100000:2.0:1788940865.437815:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944961152 00000100:00100000:2.0:1788940865.437820:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944961152 00000100:00100000:2.0:1788940865.437858:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788940865.437866:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:18663:x1875839944961152:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788940865.437900:0:17144:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788940865.437913:0:17144:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788940865.446093:0:17144:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788940865.446108:0:17144:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788940865.446191:0:17166:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788940865.446195:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788940865.446217:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade4f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.446237:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d001219a00/0x9c34acc08bade441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade43a expref: 21 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.446245:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584c600/0x9c34acc08bade44f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade448 expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.446253:0:17166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade4f7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.446315:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584c600/0x9c34acc08bade44f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08bade448 expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.446328:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584c600/0x9c34acc08bade44f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08bade448 expref: 21 pid: 17145 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940865.446341:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875839944961280:0@lo:104: 00000100:00100000:0.0:1788940865.446417:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788940865.446464:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d001219a00/0x9c34acc08bade441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08bade43a expref: 21 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.446474:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d001219a00/0x9c34acc08bade441 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08bade43a expref: 21 pid: 17144 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940865.446483:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875839944961408:0@lo:104: 00000100:00100000:0.0:1788940865.446508:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940865.446525:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06e90e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940865.446554:0:17134:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788940865.446585:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944961280 00000100:00100000:0.0:1788940865.446593:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944961280 00000100:00100000:0.0:1788940865.446624:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944961408 00000100:00100000:0.0:1788940865.446628:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944961408 00000100:00100000:0.0:1788940865.446641:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788940865.446649:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+4:17166:x1875839944961280:12345-0@lo:104: 00010000:00010000:0.0:1788940865.446664:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d0355e6400/0x9c34acc08bade448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade44f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.446718:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788940865.446724:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+4:17166:x1875839944961280:12345-0@lo:104: Request processed in 75us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940865.446731:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788940865.446747:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788940865.446753:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+3:17166:x1875839944961408:12345-0@lo:104: 00010000:00010000:0.0:1788940865.446760:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08bade43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade441 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.446814:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788940865.446820:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+3:17166:x1875839944961408:12345-0@lo:104: Request processed in 67us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940865.446826:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788940865.446836:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940865.446844:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0355e6400/0x9c34acc08bade448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade44f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940865.446851:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6400 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940865.446855:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e6400/0x9c34acc08bade448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08bade44f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940865.446864:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0355e6400/0x9c34acc08bade448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08bade44f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.446869:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1788940865.446872:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e6400/0x9c34acc08bade448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08bade44f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940865.446878:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940865.446905:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0355e6400/0x9c34acc08bade448 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade44f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940865.446911:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940865.446931:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0355e6400/0x9c34acc08bade448 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade44f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940865.447017:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875839944961280:0@lo:104: 00000100:00100000:0.0:1788940865.447026:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875839944961408:0@lo:104: 00010000:00010000:0.0:1788940865.447044:0:17166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade4f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940865.447399:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0355e6400/0x9c34acc08bade448 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade44f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940865.447413:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940865.447414:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940865.447416:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940865.447448:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944961536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940865.447482:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940865.447526:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944961536 00000100:00100000:2.0:1788940865.447531:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944961536 00010000:00010000:2.0:1788940865.447549:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584c600/0x9c34acc08bade44f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade448 expref: 22 pid: 17145 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940865.447569:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788940865.447587:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:3645:x1875839944961536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940865.447597:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940865.447602:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584c600/0x9c34acc08bade44f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade448 expref: 22 pid: 17145 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940865.447611:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584c600/0x9c34acc08bade44f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08bade448 expref: 22 pid: 17145 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940865.447624:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584c600/0x9c34acc08bade44f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08bade448 expref: 22 pid: 17145 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940865.447634:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940865.447657:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:3645:x1875839944961536:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940865.447664:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788940865.447691:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944961536:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940865.450653:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940865.450659:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940865.450661:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940865.450695:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08bade43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade441 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.450709:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584c800 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788940865.450714:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08bade43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08bade441 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.450725:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08bade43a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08bade441 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940865.450732:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08bade43a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08bade441 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940865.450739:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788940865.450786:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08bade43a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade441 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.450792:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940865.450823:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08bade43a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade441 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.450830:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584c800/0x9c34acc08bade43a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade441 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.450845:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940865.450847:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940865.450849:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940865.450866:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:303c4994-a6d4-4c7c-823f-eb7dad50725e:3646:1875839944961664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940865.450909:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940865.450967:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944961664 00000100:00100000:0.0:1788940865.450975:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944961664 00010000:00010000:0.0:1788940865.450998:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d001219a00/0x9c34acc08bade441 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade43a expref: 21 pid: 17144 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940865.451029:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788940865.451038:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037738450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:3646:x1875839944961664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940865.451050:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940865.451055:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d001219a00/0x9c34acc08bade441 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade43a expref: 21 pid: 17144 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.451066:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d001219a00/0x9c34acc08bade441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08bade43a expref: 21 pid: 17144 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.451079:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d001219a00/0x9c34acc08bade441 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08bade43a expref: 21 pid: 17144 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.451090:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade4f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.451109:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade4f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788940865.451245:0:17137:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005969160s 00010000:00010000:0.0:1788940865.451251:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade4f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.451286:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade4f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.451294:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade4f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.451300:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade4f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.451306:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584ce00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940865.451310:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade4f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.451319:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade4f7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.451333:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade4f7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.451344:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940865.451376:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037738450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:3646:x1875839944961664:12345-0@lo:103:ldlm_bl.0 Request processed in 339us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940865.451383:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788940865.451442:0:17166:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade4f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.451451:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade4f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940865.451458:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade4f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940865.451496:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:303c4994-a6d4-4c7c-823f-eb7dad50725e:3646:1875839944961664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940865.451631:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+19:18663:x1875839944961152:12345-0@lo:253:mount.lustre.0 Request processed in 13764us (13868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940865.451647:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788940865.451734:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:18663:1875839944961152:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788940865.451827:0:18663:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788940865.451830:0:18663:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788940865.451832:0:18663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788940865.451833:0:18663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940865.451834:0:18663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940865.451835:0:18663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940865.451836:0:18663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940865.451837:0:18663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940865.451838:0:18663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940865.451839:0:18663:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788940865.451850:0:18663:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1788940865.461014:0:18663:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788940865.469871:0:18663:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788940865.469882:0:18663:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788940865.469922:0:18663:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788940865.469971:0:18663:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788940865.469992:0:18663:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788940865.470015:0:18663:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788940865.470828:0:18663:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788940865.471048:0:18663:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788940865.821589:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788940866.395593:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788940866.502242:0:18744:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788940866.502530:0:18744:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788940866.973046:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788940866.973053:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d03547c000 from 9 10000000:01000000:1.0:1788940866.973057:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788940866.973100:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade4fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940866.973109:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade4fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940866.973118:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade4fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940866.973139:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944961792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788940866.973194:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940866.973234:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d030d49d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940866.973327:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944961792 00000100:00100000:2.0:1788940866.973334:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944961792 00000100:00100000:2.0:1788940866.973375:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788940866.973381:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+19:17147:x1875839944961792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940866.973392:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940866.973403:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade505 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade4fe expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940866.973421:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade4fe expref: 20 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940866.973428:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade4fe expref: 20 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940866.973434:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7600, rc 0) 00000100:00100000:2.0:1788940866.973470:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:17147:x1875839944961792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940866.973474:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788940866.973743:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944961792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940866.973754:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade4fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade505 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940866.973775:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade4fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade505 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940866.973812:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944961920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788940866.973845:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940866.973875:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d030d49d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940866.973974:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944961920 00000100:00100000:3.0:1788940866.973978:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944961920 00000100:00100000:3.0:1788940866.974008:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788940866.974013:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:17147:x1875839944961920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788940866.974024:0:17144:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788940866.974038:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788940866.974040:0:17144:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788940866.974104:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:17147:x1875839944961920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 90us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940866.974108:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788940866.974369:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944961920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788940866.974436:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788940866.974442:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade4fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade505 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940866.974448:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade4fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade505 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940866.974456:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788940866.974457:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91cf08ce7800 from 9 10000000:01000000:1.0:1788940866.974459:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788940866.974480:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade50c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940866.974485:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade50c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940866.974499:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade50c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940866.974515:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944962048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788940866.974552:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940866.974584:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d030d49d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940866.974640:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944962048 00000100:00100000:0.0:1788940866.974646:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944962048 00000100:00100000:0.0:1788940866.974682:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788940866.974689:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:17147:x1875839944962048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940866.974697:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940866.974709:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade513 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade50c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940866.974724:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade50c expref: 21 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940866.974733:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade50c expref: 21 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940866.974739:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584ce00, rc 0) 00000100:00100000:0.0:1788940866.974781:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:17147:x1875839944962048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940866.974787:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788940866.974942:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944962048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940866.974970:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade50c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade513 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940866.974976:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade50c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade513 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940866.975007:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944962176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788940866.975035:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940866.975058:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c7fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940866.975156:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944962176 00000100:00100000:0.0:1788940866.975167:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944962176 00000100:00100000:0.0:1788940866.975203:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788940866.975209:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:17147:x1875839944962176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788940866.975223:0:17145:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788940866.975235:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788940866.975238:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788940866.975334:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:17147:x1875839944962176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940866.975341:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788940866.975369:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944962176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788940866.975411:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788940866.975417:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade50c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade513 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940866.975424:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade50c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade513 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940867.421410:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940868.446033:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940869.471520:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940869.792990:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940869.793011:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944962304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788940869.793087:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940869.794350:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944962304 00000100:00100000:2.0:1788940869.794362:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944962304 00000100:00100000:3.0:1788940869.794484:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944962432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940869.794547:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940869.795146:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944962432 00000100:00100000:2.0:1788940869.795153:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944962432 00000100:00100000:2.0:1788940869.795173:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940869.795183:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944962304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940869.795223:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788940869.795768:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788940869.795778:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944962432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788940869.795799:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788940869.795856:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944962432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940869.795864:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788940869.795986:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944962304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 803us (2899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940869.795995:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788940869.796083:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944962432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940869.796207:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944962304:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788940870.492426:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788940870.812411:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940870.812418:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940870.812421:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940870.812424:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940870.812452:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940870.812456:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940870.812459:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940870.812462:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788940870.812501:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944962560:0@lo:400:kworker.0 00000100:00100000:3.0:1788940870.812599:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940870.812646:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944963072:0@lo:400:kworker.0 00000100:00100000:3.0:1788940870.812675:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940870.812702:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788940870.812708:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944962688:0@lo:400:kworker.0 00000100:00100000:2.0:1788940870.812718:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944962560 00000100:00100000:2.0:1788940870.812726:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944962560 00000100:00100000:3.0:1788940870.812732:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940870.812747:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944963200:0@lo:400:kworker.0 00000100:00100000:3.0:1788940870.812766:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940870.812781:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788940870.812791:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:3645:x1875839944962560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940870.812804:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944962944:0@lo:400:kworker.0 00000100:00100000:3.0:1788940870.812828:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940870.812841:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:3645:x1875839944962560:12345-0@lo:400:kworker.0 Request processed in 52us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940870.812844:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788940870.812850:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944962816:0@lo:400:kworker.0 00000100:00100000:2.0:1788940870.812857:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788940870.812892:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944962688 00000100:00100000:2.0:1788940870.812896:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944962688 00000100:00100000:2.0:1788940870.812917:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944962944 00000100:00100000:2.0:1788940870.812920:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944962944 00000100:00100000:2.0:1788940870.812933:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940870.812940:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944962688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940870.812974:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944962688:12345-0@lo:400:kworker.0 Request processed in 36us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940870.812980:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940870.812991:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788940870.812996:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944962944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940870.813024:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944962944:12345-0@lo:400:kworker.0 Request processed in 27us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940870.813029:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788940870.813065:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944962688:0@lo:400:kworker.0 00000100:00100000:2.0:1788940870.813074:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944962560:0@lo:400:kworker.0 00000100:00100000:1.0:1788940870.813294:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944963072 00000100:00100000:1.0:1788940870.813300:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944963072 00000100:00100000:1.0:1788940870.813318:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944963200 00000100:00100000:1.0:1788940870.813321:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944963200 00000100:00100000:1.0:1788940870.813348:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788940870.813355:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944963072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940870.813390:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944963072:12345-0@lo:400:kworker.0 Request processed in 36us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940870.813395:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788940870.813406:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788940870.813411:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944963200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940870.813433:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944963200:12345-0@lo:400:kworker.0 Request processed in 22us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940870.813437:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788940870.813723:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788940870.813750:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03475b100 x1875839944963200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940870.813762:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944963200:0@lo:400:kworker.0 00010000:00080000:2.0:1788940870.813787:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d034759180 x1875839944963072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940870.813797:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944963072:0@lo:400:kworker.0 00000100:00100000:3.0:1788940870.814093:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940870.814124:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944963328:0@lo:400:kworker.0 00000100:00100000:3.0:1788940870.814161:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940870.814174:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944962816 00000100:00100000:1.0:1788940870.814178:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944962816 00000100:00100000:3.0:1788940870.814181:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944962944:0@lo:400:kworker.0 00000100:00100000:1.0:1788940870.814195:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944963328 00000100:00100000:1.0:1788940870.814197:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944963328 00000100:00100000:3.0:1788940870.814201:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788940870.814208:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944962816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940870.814224:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788940870.814236:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788940870.814243:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944962816:12345-0@lo:400:kworker.0 Request processed in 37us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940870.814250:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788940870.814278:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788940870.814285:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944963328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940870.814309:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944963328:12345-0@lo:400:kworker.0 Request processed in 26us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940870.814315:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788940870.814339:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d03475a300 x1875839944962816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940870.814348:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944962816:0@lo:400:kworker.0 00010000:00080000:3.0:1788940870.814356:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d034758700 x1875839944963328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940870.814364:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944963328:0@lo:400:kworker.0 00000100:00080000:2.0:1788940870.814521:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788940871.515403:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940871.644561:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788940872.541766:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788940872.553323:0:19034:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1788940873.395930:0:19087:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788940873.396965:0:19087:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788940873.564916:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788940874.271704:0:19137:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788940874.272012:0:19137:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788940874.588392:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940874.651403:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940859/real 1788940859] req@ffff91d018b09500 x1875839944957312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940874 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940874.651438:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d018b09500 x1875839944957312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940874 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940874.651448:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940859/real 1788940859] req@ffff91d018b09f80 x1875839944957440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940874 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940874.651460:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d018b09f80 x1875839944957440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940874 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788940874.651479:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788940874.651524:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788940874.651528:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944957312:0@lo:8:kworker.0 00000100:00080000:1.0:1788940874.651534:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02e8ea000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788940874.651539:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788940874.651542:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944957440:0@lo:8:kworker.0 00000100:00100000:1.0:1788940874.651715:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940874.651784:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944963584:0@lo:400:kworker.0 00000100:00100000:2.0:1788940874.651854:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788940874.651906:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940874.651910:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940874.651913:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940874.651916:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788940874.652036:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944963712:0@lo:400:kworker.0 00000100:00100000:0.0:1788940874.652075:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940874.652107:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944963712 00000100:00100000:0.0:1788940874.652114:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944963712 00000100:00100000:0.0:1788940874.652153:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788940874.652166:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944963712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940874.652209:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944963712:12345-0@lo:400:kworker.0 Request processed in 44us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940874.652226:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788940874.652289:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf07844e00 x1875839944963712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940874.652302:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944963712:0@lo:400:kworker.0 00000100:00100000:0.0:1788940874.652321:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944963584 00000100:00100000:0.0:1788940874.652323:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944963584 00000100:00100000:0.0:1788940874.652345:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788940874.652351:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944963584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940874.653991:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944963456:0@lo:400:kworker.0 00000100:00100000:1.0:1788940874.654880:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940874.654940:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944963456 00000100:00100000:1.0:1788940874.654947:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944963456 00000100:00100000:1.0:1788940874.654989:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788940874.654997:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:3647:x1875839944963456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940874.655040:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:3647:x1875839944963456:12345-0@lo:400:kworker.0 Request processed in 44us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940874.655047:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788940874.655122:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944963456:0@lo:400:kworker.0 00000100:00080000:3.0:1788940874.657889:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940874.657896:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788940874.657900:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940874.657908:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 614 00000100:00080000:3.0:1788940874.657915:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788940874.657921:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff91d02e8d2800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940874.657941:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf07844700 x1875839944963968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788940874.657955:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940874.657959:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788940874.657960:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d02e8ea000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940874.657963:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 614 00000100:00080000:3.0:1788940874.657965:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788940874.657969:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91d02e8ea000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940874.657979:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf07846d80 x1875839944964096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940874.658058:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839944964480:0@lo:400:kworker.0 00000100:00100000:3.0:1788940874.658127:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940874.658165:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940874.658171:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944964352:0@lo:400:kworker.0 00000100:00100000:3.0:1788940874.658191:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940874.658630:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944964480 00000100:00100000:1.0:1788940874.658639:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944964480 00000100:00100000:1.0:1788940874.658699:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944964352 00000100:00100000:1.0:1788940874.658702:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944964352 00000100:00100000:1.0:1788940874.658725:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788940874.658733:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839944964480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940874.658787:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839944964480:12345-0@lo:400:kworker.0 Request processed in 55us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940874.658795:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788940874.658821:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788940874.658827:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944964352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940874.658855:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944964352:12345-0@lo:400:kworker.0 Request processed in 29us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940874.658861:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788940874.658893:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944963968:0@lo:8:kworker.0 00000100:00100000:1.0:1788940874.658923:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940874.658948:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944964096:0@lo:8:kworker.0 00000100:00100000:1.0:1788940874.658970:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788940874.659035:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf07845180 x1875839944964352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940874.659062:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944964352:0@lo:400:kworker.0 00010000:00080000:1.0:1788940874.659079:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf07847480 x1875839944964480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940874.659088:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839944964480:0@lo:400:kworker.0 00000100:00100000:1.0:1788940874.659119:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944963840:0@lo:400:kworker.0 00000100:00100000:1.0:1788940874.659145:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940874.659165:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940874.659171:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944964224:0@lo:400:kworker.0 00000100:00100000:1.0:1788940874.659193:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940874.659217:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944963840 00000100:00100000:1.0:1788940874.659221:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944963840 00000100:00100000:1.0:1788940874.659241:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788940874.659246:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944963840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940874.659305:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944963840:12345-0@lo:400:kworker.0 Request processed in 58us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940874.659310:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788940874.659326:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944964224 00000100:00100000:1.0:1788940874.659329:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944964224 00000100:00100000:1.0:1788940874.659347:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788940874.659352:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944964224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940874.659376:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944964224:12345-0@lo:400:kworker.0 Request processed in 24us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940874.659381:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788940874.659413:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf07845880 x1875839944964224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940874.659421:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944964224:0@lo:400:kworker.0 00000100:00100000:1.0:1788940874.659429:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944963840:0@lo:400:kworker.0 00000100:00080000:3.0:1788940874.659727:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940874.659732:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788940874.659752:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944963968 00000100:00100000:3.0:1788940874.659756:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944963968 00000100:00100000:3.0:1788940874.659795:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944964096 00000100:00100000:3.0:1788940874.659807:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944964096 00000100:00100000:3.0:1788940874.659819:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940874.659824:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875839944963968:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788940874.659849:0:18668:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 629 last 0 00000020:00000080:3.0:1788940874.659876:0:18668:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08bade51a 00002000:00100000:3.0:1788940874.659889:0:18668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff91cf08f3a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788940874.659893:0:18668:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788940874.659895:0:18668:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788940874.660332:0:18668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788940874.660357:0:18668:0:(import.c:65:import_set_state_nolock()) ffff91cf08f3b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940874.660407:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875839944963968:12345-0@lo:8:kworker.0 Request processed in 582us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940874.660415:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940874.660432:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940874.660437:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875839944964096:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788940874.660449:0:18668:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788940874.662971:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944963584:12345-0@lo:400:kworker.0 Request processed in 10607us (11105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940874.662988:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788940874.664618:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf07844700 x1875839944963968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788940894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940874.664656:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788940874.664668:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788940874.664679:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788940874.664687:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788940874.664691:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d2800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788940874.664723:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788940874.664729:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944963968:0@lo:8:kworker.0 00000004:00080000:1.0:1788940874.664760:0:17891:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788940874.664872:0:17891:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 629997614457ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788940874.664880:0:17891:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1788940874.665117:0:17892:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788940874.665145:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1875839944964736:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788940874.665211:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940874.665236:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03117b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940874.665248:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940874.665279:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944964608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940874.665307:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940874.665368:0:18670:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788940874.665375:0:18670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788940874.665479:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944964736 00000100:00100000:0.0:1788940874.665487:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944964736 00000100:00100000:0.0:1788940874.665609:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940874.665619:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17892:x1875839944964736:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:0.0:1788940874.666190:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940874.666213:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944964608 00000100:00100000:0.0:1788940874.666219:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944964608 00000100:00100000:0.0:1788940874.666331:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940874.666340:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1875839944964608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788940874.666360:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788940874.666414:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1875839944964608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940874.666421:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940874.666520:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944963584:0@lo:400:kworker.0 00010000:00080000:1.0:1788940874.674146:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf07fdb480 x1875839944964608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940874.674175:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944964608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940874.674680:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875839944964096:12345-0@lo:8:kworker.0 Request processed in 14239us (15706us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788940874.674692:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:2.0:1788940874.675099:0:17882:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00080000:0.0:1788940874.675237:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02e8ea000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940874.675243:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788940874.675247:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944964096:0@lo:8:kworker.0 00002000:00080000:1.0:1788940874.677968:0:19149:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788940874.677979:0:19149:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788940874.678153:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17892:x1875839944964736:12345-0@lo:7:osp-pre-0-1.0 Request processed in 12531us (12936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940874.678172:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788940874.678476:0:17892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf07fd8e00 x1875839944964736/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788940890 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940874.678503:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1875839944964736:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788940874.678520:0:17892:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788940874.678672:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1875839944964864:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788940874.678714:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940874.678744:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0207fb780 going to sleep for 11 seconds 00000100:00100000:0.0:1788940874.678813:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944964864 00000100:00100000:0.0:1788940874.678819:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944964864 00000100:00100000:0.0:1788940874.678866:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788940874.678875:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17892:x1875839944964864:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788940874.678901:0:18670:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788940874.678943:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17892:x1875839944964864:12345-0@lo:5:osp-pre-0-1.0 Request processed in 69us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940874.678950:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788940874.679071:0:17892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf07845f80 x1875839944964864/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940890 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940874.679081:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1875839944964864:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788940874.679100:0:17892:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788940874.679126:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1875839944964992:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788940874.679148:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940874.679173:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0207fb780 going to sleep for 11 seconds 00000100:00100000:2.0:1788940874.679301:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944964992 00000100:00100000:2.0:1788940874.679306:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944964992 00000100:00100000:2.0:1788940874.679333:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940874.679341:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17892:x1875839944964992:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788940874.679367:0:18669:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:2.0:1788940874.698524:0:18664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788940874.698543:0:18664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788940874.698750:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17892:x1875839944964992:12345-0@lo:5:osp-pre-0-1.0 Request processed in 19405us (19595us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788940874.698762:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788940874.698871:0:17892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf07845f80 x1875839944964992/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940890 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940874.698901:0:17892:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788940874.698908:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17892:1875839944964992:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788940874.698926:0:17892:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1788940874.698984:0:17892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17892:1875839944965120:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788940874.699022:0:17892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940874.699063:0:17892:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03117b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940874.699179:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944965120 00000100:00100000:2.0:1788940874.699187:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944965120 00000100:00100000:2.0:1788940874.699232:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940874.699241:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17892:x1875839944965120:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788940874.699320:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17892:x1875839944965120:12345-0@lo:900:osp-pre-0-1.0 Request processed in 80us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940874.699327:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788940874.699397:0:17892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf07fd8e00 x1875839944965120/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788940890 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940874.699407:0:17892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17892:1875839944965120:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788940874.907456:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940874.907478:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944965248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940874.907560:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940874.907609:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944965248 00000100:00100000:3.0:1788940874.907616:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944965248 00000100:00100000:3.0:1788940874.907657:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788940874.907667:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944965248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788940874.907700:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788940874.907757:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944965248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940874.907764:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788940874.907808:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944965248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788940874.907910:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940874.907920:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944965376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940874.907950:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940874.907990:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944965376 00000100:00100000:1.0:1788940874.907994:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944965376 00000100:00100000:1.0:1788940874.908017:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788940874.908022:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944965376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788940874.908041:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788940874.908084:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944965376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940874.908090:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788940874.908127:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944965376:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788940875.036250:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788940875.622369:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940876.637752:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940877.660644:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940877.728810:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940857/real 1788940857] req@ffff91d020c8d180 x1875839944954880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940877 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940877.729898:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d020c8d180 x1875839944954880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940877 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940877.729925:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940857/real 1788940857] req@ffff91d020c8ed80 x1875839944955008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940877 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940877.729939:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d020c8ed80 x1875839944955008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940877 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788940877.729958:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03ece2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940877.729980:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788940877.729985:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944954880:0@lo:8:kworker.0 00000100:00080000:3.0:1788940877.729990:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03ed25000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940877.729995:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788940877.729998:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944955008:0@lo:8:kworker.0 00000100:00080000:0.0:1788940877.730398:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788940877.730403:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788940877.730406:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d03ece2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788940877.730411:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 612 00000100:00080000:0.0:1788940877.730416:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788940877.730423:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91d03ece2000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1788940877.730442:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf08dd3100 x1875839944965760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788940877.730453:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788940877.730456:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788940877.730458:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d03ed25000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788940877.730470:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 612 00000100:00080000:0.0:1788940877.730473:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788940877.730477:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d03ed25000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1788940877.730494:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf08dd1c00 x1875839944965888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788940877.730519:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788940877.730522:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788940877.730524:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d02e8ea000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788940877.730527:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 629 00000100:00080000:0.0:1788940877.730529:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788940877.730533:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91d02e8ea000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1788940877.730549:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf08dd0a80 x1875839944966400/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940877.730587:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944966016:0@lo:400:kworker.0 00000100:00100000:0.0:1788940877.730644:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940877.730669:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944966656:0@lo:400:kworker.0 00000100:00100000:0.0:1788940877.730687:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940877.730704:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788940877.730709:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944965632:0@lo:400:kworker.0 00000100:00100000:0.0:1788940877.730735:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940877.730759:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944966528:0@lo:400:kworker.0 00000100:00100000:0.0:1788940877.730780:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940877.730992:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07fd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:303c4994-a6d4-4c7c-823f-eb7dad50725e:3646:1875839944965504:0@lo:400:kworker.0 00000100:00100000:1.0:1788940877.731023:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940877.731052:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944966272:0@lo:400:kworker.0 00000100:00100000:1.0:1788940877.731075:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940877.731098:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788940877.731103:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944966144:0@lo:400:kworker.0 00000100:00100000:1.0:1788940877.731124:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940877.731140:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839944966784:0@lo:400:kworker.0 00000100:00100000:1.0:1788940877.731159:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940877.731195:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944966016 00000100:00100000:1.0:1788940877.731202:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944966016 00000100:00100000:1.0:1788940877.731237:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944966656 00000100:00100000:1.0:1788940877.731240:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944966656 00000100:00100000:1.0:1788940877.731288:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944966528 00000100:00100000:1.0:1788940877.731291:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944966528 00000100:00100000:1.0:1788940877.731302:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944966784 00000100:00100000:1.0:1788940877.731304:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944966784 00000100:00100000:1.0:1788940877.731318:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788940877.731325:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944966016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940877.731376:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944966016:12345-0@lo:400:kworker.0 Request processed in 51us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940877.731383:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788940877.731409:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788940877.731416:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944966656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940877.731442:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944966656:12345-0@lo:400:kworker.0 Request processed in 27us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940877.731447:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788940877.731456:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788940877.731471:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944966528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940877.731494:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944966528:12345-0@lo:400:kworker.0 Request processed in 33us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940877.731500:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788940877.731510:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788940877.731514:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839944966784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940877.731538:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839944966784:12345-0@lo:400:kworker.0 Request processed in 24us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940877.731554:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788940877.731576:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944966272 00000100:00100000:1.0:1788940877.731580:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944966272 00000100:00100000:1.0:1788940877.731606:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940877.731612:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944966272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940877.731640:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944966272:12345-0@lo:400:kworker.0 Request processed in 29us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940877.731645:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940877.731663:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944965632 00000100:00100000:1.0:1788940877.731666:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944965632 00000100:00100000:1.0:1788940877.731686:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944966144 00000100:00100000:1.0:1788940877.731689:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944966144 00000100:00100000:1.0:1788940877.731701:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788940877.731713:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944965632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940877.731747:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944965632:12345-0@lo:400:kworker.0 Request processed in 34us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940877.731753:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788940877.731765:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788940877.731770:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944966144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940877.731796:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944966144:12345-0@lo:400:kworker.0 Request processed in 26us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940877.731801:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788940877.731822:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940877.731826:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940877.731828:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940877.731871:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944965632:0@lo:400:kworker.0 00000100:00100000:3.0:1788940877.732322:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944965760:0@lo:8:kworker.0 00000100:00100000:3.0:1788940877.732365:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940877.732395:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944965888:0@lo:8:kworker.0 00000100:00100000:3.0:1788940877.732420:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940877.732436:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944966400:0@lo:8:kworker.0 00000100:00100000:3.0:1788940877.732453:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940877.732497:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944965760 00000100:00100000:3.0:1788940877.732503:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944965760 00000100:00100000:3.0:1788940877.732520:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944965888 00000100:00100000:3.0:1788940877.732523:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944965888 00000100:00100000:3.0:1788940877.732529:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944966400 00000100:00100000:3.0:1788940877.732532:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944966400 00000100:00100000:3.0:1788940877.732552:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940877.732557:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875839944965760:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788940877.732595:0:18668:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 633 last 0 00000020:00000080:3.0:1788940877.732626:0:18668:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08bade521 00002000:00100000:3.0:1788940877.732640:0:18668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91d03473f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788940877.732644:0:18668:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788940877.732647:0:18668:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788940877.732728:0:18668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788940877.732753:0:18668:0:(import.c:65:import_set_state_nolock()) ffff91d03473d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940877.732792:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875839944965760:12345-0@lo:8:kworker.0 Request processed in 233us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940877.732798:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940877.732810:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940877.732814:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875839944965888:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788940877.732824:0:18668:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788940877.732845:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875839944965888:12345-0@lo:8:kworker.0 Request processed in 29us (423us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788940877.732850:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940877.732859:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940877.732863:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875839944966400:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788940877.732871:0:18668:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788940877.734085:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875839944966400:12345-0@lo:8:kworker.0 Request processed in 1214us (1623us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788940877.734098:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788940877.734171:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf08dd3100 x1875839944965760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788940902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788940877.734327:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf08dd0e00 x1875839944966528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940877.734347:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944966528:0@lo:400:kworker.0 00010000:00080000:1.0:1788940877.734368:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf08dd2d80 x1875839944966016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940877.734377:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944966016:0@lo:400:kworker.0 00010000:00080000:1.0:1788940877.734388:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf08dd3b80 x1875839944966656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940877.734396:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944966656:0@lo:400:kworker.0 00000100:00100000:1.0:1788940877.734455:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944966144:0@lo:400:kworker.0 00010000:00080000:1.0:1788940877.734495:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf08dd2a00 x1875839944966784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940877.734503:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839944966784:0@lo:400:kworker.0 00010000:00080000:1.0:1788940877.734516:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf08dd0380 x1875839944966272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940877.734523:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944966272:0@lo:400:kworker.0 00000100:00100000:3.0:1788940877.734715:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788940877.734730:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788940877.734740:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788940877.734746:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788940877.734749:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03ece2000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788940877.734779:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788940877.734786:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944965760:0@lo:8:kworker.0 00000100:00080000:3.0:1788940877.734802:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03ed25000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940877.734806:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788940877.734809:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944965888:0@lo:8:kworker.0 00000100:00080000:3.0:1788940877.734818:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02e8ea000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940877.734822:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788940877.734824:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944966400:0@lo:8:kworker.0 00000004:00080000:2.0:1788940877.735152:0:17174:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788940877.735298:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944965504 00000100:00100000:0.0:1788940877.735308:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944965504 00000100:00100000:0.0:1788940877.735350:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788940877.735358:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:3646:x1875839944965504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940877.735429:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:3646:x1875839944965504:12345-0@lo:400:kworker.0 Request processed in 71us (4404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940877.735445:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788940877.735680:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:1.0:1788940877.735701:0:17175:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1788940877.735725:0:17175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17175:1875839944967040:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788940877.735764:0:17175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940877.735785:0:17175:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d030d496c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940877.735842:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07fd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:303c4994-a6d4-4c7c-823f-eb7dad50725e:3646:1875839944965504:0@lo:400:kworker.0 00000004:00080000:2.0:1788940877.735993:0:17174:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633068735112ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788940877.736001:0:17174:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788940877.739068:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944967040 00000100:00100000:3.0:1788940877.739082:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944967040 00000100:00100000:3.0:1788940877.739153:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788940877.739163:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17175:x1875839944967040:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1788940877.739430:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788940877.742623:0:18668:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788940877.742636:0:18668:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788940877.742643:0:18668:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00100000:0.0:1788940877.744334:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944966912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940877.744411:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940877.744721:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944966912 00000100:00100000:2.0:1788940877.744731:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944966912 00000100:00100000:2.0:1788940877.744785:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940877.744795:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875839944966912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940877.744828:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788940877.745017:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875839944966912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 223us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940877.745025:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788940877.745067:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf079eb100 x1875839944966912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940877.745087:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944966912:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788940877.760892:0:17130:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788940877.760942:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788940877.760951:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade528 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.760970:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=633s v=(0 0) 00010000:00010000:1.0:1788940877.760975:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940877.760982:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade528 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.761001:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade528 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.761022:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade528 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.761030:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade528 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.761054:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940877.761087:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940877.761094:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade528 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.761102:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602e00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940877.761107:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade528 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.761126:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade528 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.761145:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade528 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.761152:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade528 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.761171:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.761173:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.761174:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940877.764005:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788940877.764019:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade52f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.764035:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=633s v=(0 0) 00010000:00010000:1.0:1788940877.764040:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940877.764046:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade52f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.764059:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade52f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.764069:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade52f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.764076:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade52f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.764155:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940877.766959:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788940877.766972:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade536 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.766990:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=633s v=(0 0) 00010000:00010000:2.0:1788940877.766996:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940877.767002:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade536 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.767018:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade536 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.767029:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade536 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.767037:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade536 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.771521:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940877.771537:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade52f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.771551:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940877.771556:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade52f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.771567:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade52f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.771588:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade52f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.771949:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade52f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.771971:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940877.771975:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade536 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.771982:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940877.771986:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade536 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.771994:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade536 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.772006:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade536 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.772013:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.772015:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.772017:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940877.778413:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788940877.778431:0:18668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade536 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.779530:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940877.780641:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940877.780652:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade53d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.780670:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=633s v=(0 0) 00010000:00010000:3.0:1788940877.780682:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940877.780690:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade53d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.780706:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade53d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.780716:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade53d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.780724:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade53d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.780740:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940877.780751:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940877.780756:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade53d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.780765:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940877.780769:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade53d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.780778:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade53d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.780795:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade53d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.780812:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade53d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.780828:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.780830:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.780832:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940877.781489:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940877.781497:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078d72a3f/0x9c34acc08bade544 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.781506:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=633s v=(0 0) 00010000:00010000:3.0:1788940877.781510:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940877.781515:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078d72a3f/0x9c34acc08bade544 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.781525:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078d72a3f/0x9c34acc08bade544 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.781533:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078d72a3f/0x9c34acc08bade544 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.781540:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078d72a3f/0x9c34acc08bade544 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.781563:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940877.781620:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940877.781628:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078d72a3f/0x9c34acc08bade544 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.781639:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218000 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940877.781643:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078d72a3f/0x9c34acc08bade544 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.781653:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078d72a3f/0x9c34acc08bade544 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.781669:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078d72a3f/0x9c34acc08bade544 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.781677:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078d72a3f/0x9c34acc08bade544 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.781696:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940877.781699:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940877.781701:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940877.781821:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940877.781832:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cee6f667/0x9c34acc08bade54b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.781840:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=633s v=(0 0) 00010000:00010000:3.0:1788940877.781843:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940877.781847:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cee6f667/0x9c34acc08bade54b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.781856:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cee6f667/0x9c34acc08bade54b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.781865:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cee6f667/0x9c34acc08bade54b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.781872:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cee6f667/0x9c34acc08bade54b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.781895:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940877.781980:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940877.781993:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cee6f667/0x9c34acc08bade54b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.782001:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940877.782005:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cee6f667/0x9c34acc08bade54b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.782014:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cee6f667/0x9c34acc08bade54b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.782027:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cee6f667/0x9c34acc08bade54b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.782034:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cee6f667/0x9c34acc08bade54b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.782051:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940877.782054:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940877.782055:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940877.782511:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940877.782518:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034449836/0x9c34acc08bade552 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.782527:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=633s v=(0 0) 00010000:00010000:3.0:1788940877.782530:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940877.782534:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034449836/0x9c34acc08bade552 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.782543:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034449836/0x9c34acc08bade552 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.782557:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034449836/0x9c34acc08bade552 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.782564:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034449836/0x9c34acc08bade552 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.782584:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940877.782606:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940877.782613:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034449836/0x9c34acc08bade552 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.782622:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940877.782625:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034449836/0x9c34acc08bade552 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.782645:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034449836/0x9c34acc08bade552 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.782658:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034449836/0x9c34acc08bade552 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.782665:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034449836/0x9c34acc08bade552 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.782680:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940877.782682:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940877.782684:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940877.782918:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940877.782924:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08bade559 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.782933:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=633s v=(0 0) 00010000:00010000:3.0:1788940877.782936:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940877.782939:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08bade559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.782948:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08bade559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.782956:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08bade559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.782962:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08bade559 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.783046:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788940877.783589:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940877.783595:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade560 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.783605:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=633s v=(0 0) 00010000:00010000:3.0:1788940877.783608:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940877.783612:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.783622:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.783630:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.783637:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.784927:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940877.784940:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08bade559 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.784953:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940877.784958:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08bade559 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.784970:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08bade559 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.784989:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08bade559 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.785009:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08bade559 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.785577:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940877.785584:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade560 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.785593:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940877.785597:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade560 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.785605:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade560 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.785618:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade560 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.785652:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940877.785654:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940877.785656:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.787802:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788940877.787815:0:18668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade560 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940877.789751:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940877.789765:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade567 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.789797:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=633s v=(0 0) 00010000:00010000:3.0:1788940877.789802:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940877.789809:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade567 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.789825:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade567 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.789837:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade567 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.789845:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade567 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.792497:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940877.792514:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade567 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.792528:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940877.792540:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade567 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.792552:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade567 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.792575:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade567 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.792585:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940877.792587:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940877.792589:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.793286:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788940877.793430:0:18668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade567 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.793733:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940877.794621:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940877.795099:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade56e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.795116:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=633s v=(0 0) 00010000:00010000:3.0:1788940877.795121:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940877.795128:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade56e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.795850:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade56e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.795862:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade56e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.795871:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade56e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.795938:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788940877.797236:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940877.797246:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade575 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.797283:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=633s v=(0 0) 00010000:00010000:3.0:1788940877.797288:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940877.797302:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade575 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.797316:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade575 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.797325:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade575 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.797344:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade575 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.800827:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940877.800844:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade56e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.800859:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940877.800865:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade56e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.800877:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade56e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.800900:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade56e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.800908:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08bade56e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.800953:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940877.800957:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade575 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.800965:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219e00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940877.800968:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade575 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.800976:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade575 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.800985:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade575 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.800992:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940877.800993:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940877.800995:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.802273:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788940877.802285:0:18668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade575 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940877.803818:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788940877.803830:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade57c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.803846:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=633s v=(0 0) 00010000:00010000:1.0:1788940877.803850:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940877.803856:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade57c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.803869:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade57c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.803878:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade57c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.803885:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade57c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.806738:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940877.806756:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade57c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.806773:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602000 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940877.806778:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade57c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.806817:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade57c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.806842:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade57c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.806854:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940877.806857:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940877.806859:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940877.811428:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788940877.811456:0:18668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e87ddc7/0x9c34acc08bade57c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.811540:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940877.813754:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788940877.813770:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002099389a/0x9c34acc08bade583 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.813807:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=633s v=(0 0) 00010000:00010000:1.0:1788940877.813813:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940877.813821:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002099389a/0x9c34acc08bade583 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.813839:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002099389a/0x9c34acc08bade583 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.813850:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002099389a/0x9c34acc08bade583 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.813857:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002099389a/0x9c34acc08bade583 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.813884:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788940877.815382:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788940877.815395:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade58a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.815410:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=633s v=(0 0) 00010000:00010000:1.0:1788940877.815415:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940877.815421:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade58a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.815447:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade58a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.815663:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade58a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.815673:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade58a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.815699:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788940877.815743:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940877.815752:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002099389a/0x9c34acc08bade583 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.815760:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940877.815765:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002099389a/0x9c34acc08bade583 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.815775:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002099389a/0x9c34acc08bade583 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.815793:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002099389a/0x9c34acc08bade583 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.815801:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002099389a/0x9c34acc08bade583 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.815822:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940877.815830:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade58a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.815836:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940877.815839:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade58a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.815847:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade58a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.815857:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade58a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.815864:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08bade58a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.815877:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.815879:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.815881:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.816311:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940877.816336:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788940877.816343:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade591 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.816352:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=633s v=(0 0) 00010000:00010000:1.0:1788940877.816356:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940877.816361:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade591 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.816370:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade591 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.816379:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade591 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.816387:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade591 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.816421:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940877.816458:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940877.816483:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade591 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.816491:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602e00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940877.816495:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade591 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.816515:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade591 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.816527:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade591 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.816534:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fd507b0/0x9c34acc08bade591 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.816549:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.816551:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.816552:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940877.822859:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788940877.822873:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade598 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.822891:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=633s v=(0 0) 00010000:00010000:2.0:1788940877.822896:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940877.822902:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade598 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.822917:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade598 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.822928:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade598 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.822936:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade598 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.822976:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940877.823293:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940877.823300:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade598 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.823309:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940877.823314:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade598 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.823323:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade598 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.823342:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade598 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.823348:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e629a21b/0x9c34acc08bade598 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.823371:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940877.823372:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940877.823374:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940877.824569:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788940877.824580:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08bade59f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.824594:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=633s v=(0 0) 00010000:00010000:2.0:1788940877.824598:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940877.824603:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08bade59f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.824613:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08bade59f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.825190:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08bade59f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.825203:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08bade59f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940877.825225:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940877.827127:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940877.827149:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08bade59f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.827161:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940877.827166:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08bade59f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.827176:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08bade59f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.827197:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08bade59f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.827216:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bfbb431/0x9c34acc08bade59f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.827234:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.827236:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.827238:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940877.831102:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788940877.831119:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077172e50/0x9c34acc08bade5a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.831143:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=633s v=(0 0) 00010000:00010000:0.0:1788940877.831147:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940877.831154:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077172e50/0x9c34acc08bade5a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.831170:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077172e50/0x9c34acc08bade5a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.831181:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077172e50/0x9c34acc08bade5a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.831202:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077172e50/0x9c34acc08bade5a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.831227:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940877.831479:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940877.831487:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077172e50/0x9c34acc08bade5a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.831497:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584c600 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940877.831502:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077172e50/0x9c34acc08bade5a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.831513:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077172e50/0x9c34acc08bade5a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.831532:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077172e50/0x9c34acc08bade5a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.831541:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077172e50/0x9c34acc08bade5a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.831560:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.831563:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.831564:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940877.833731:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788940877.833747:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ab13d23/0x9c34acc08bade5ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.833764:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=633s v=(0 0) 00010000:00010000:0.0:1788940877.833769:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940877.833777:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ab13d23/0x9c34acc08bade5ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.833791:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ab13d23/0x9c34acc08bade5ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.833814:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ab13d23/0x9c34acc08bade5ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.833822:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ab13d23/0x9c34acc08bade5ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.833850:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940877.834483:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940877.834493:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ab13d23/0x9c34acc08bade5ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.834503:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584c800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940877.834508:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ab13d23/0x9c34acc08bade5ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.834519:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ab13d23/0x9c34acc08bade5ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.834541:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ab13d23/0x9c34acc08bade5ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.834550:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ab13d23/0x9c34acc08bade5ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.834573:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.834575:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.834577:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940877.836832:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940877.836846:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade5b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.836862:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=633s v=(0 0) 00010000:00010000:3.0:1788940877.836867:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940877.836872:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade5b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.836906:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade5b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.836917:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade5b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.836926:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade5b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.836952:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940877.837356:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940877.837365:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade5b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.837373:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219e00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940877.837378:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade5b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.837386:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade5b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.837402:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade5b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.837409:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a1db07b/0x9c34acc08bade5b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.837428:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940877.837676:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940877.837678:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940877.845216:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788940877.845231:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08bade5bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.845249:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=633s v=(0 0) 00010000:00010000:0.0:1788940877.845274:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940877.845282:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08bade5bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.845297:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08bade5bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.845309:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08bade5bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.845317:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08bade5bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.845335:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788940877.847965:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788940877.847979:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000117e74b7/0x9c34acc08bade5c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.847997:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=633s v=(0 0) 00010000:00010000:0.0:1788940877.848002:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940877.848009:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000117e74b7/0x9c34acc08bade5c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.848030:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000117e74b7/0x9c34acc08bade5c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.848040:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000117e74b7/0x9c34acc08bade5c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.848048:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000117e74b7/0x9c34acc08bade5c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.848082:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788940877.848349:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940877.848357:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08bade5bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.848366:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584da00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940877.848370:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08bade5bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.848380:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08bade5bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.848397:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08bade5bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.848404:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08bade5bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.848424:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940877.848427:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000117e74b7/0x9c34acc08bade5c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.848443:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584cc00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940877.848447:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000117e74b7/0x9c34acc08bade5c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.848475:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000117e74b7/0x9c34acc08bade5c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.848496:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000117e74b7/0x9c34acc08bade5c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.848503:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000117e74b7/0x9c34acc08bade5c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.848516:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940877.848518:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.848519:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940877.848520:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940877.849938:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788940877.849950:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08bade5c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.849964:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=633s v=(0 0) 00010000:00010000:0.0:1788940877.849970:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940877.849976:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08bade5c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.849987:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08bade5c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.849996:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08bade5c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.850018:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08bade5c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.850044:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940877.850306:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940877.850314:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08bade5c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.850323:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584dc00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940877.850327:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08bade5c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.850336:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08bade5c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.850352:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08bade5c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.850380:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08bade5c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.850397:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.850399:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.850400:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940877.851533:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788940877.851543:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08bade5d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.851554:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=633s v=(0 0) 00010000:00010000:0.0:1788940877.851558:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940877.851563:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08bade5d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.851584:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08bade5d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.851595:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08bade5d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.851603:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08bade5d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.851627:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940877.852733:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940877.852742:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08bade5d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.852753:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584d600 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940877.852758:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08bade5d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.852767:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08bade5d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.852785:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08bade5d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.852791:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08bade5d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.852820:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.852821:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940877.852823:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940877.853290:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940877.853309:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade5d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.853322:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=633s v=(0 0) 00010000:00010000:3.0:1788940877.853326:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940877.853332:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade5d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.853344:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade5d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.853354:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade5d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.853701:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade5d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.853724:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940877.853790:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940877.853796:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade5d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.853804:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940877.853807:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade5d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.853815:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade5d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.853827:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade5d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.853844:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003536aeb4/0x9c34acc08bade5d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.853860:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940877.853862:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940877.853864:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940877.854131:0:18668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940877.854137:0:18668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade5de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.854147:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=633s v=(0 0) 00010000:00010000:3.0:1788940877.854151:0:18668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940877.854155:0:18668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade5de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.854175:0:18668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade5de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.854184:0:18668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade5de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.854192:0:18668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade5de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.854213:0:18668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788940877.854246:0:18668:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00010000:00010000:0.0:1788940877.854279:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940877.854285:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade5de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.854299:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940877.854303:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade5de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.854311:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade5de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.854322:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade5de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.854329:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008239596c/0x9c34acc08bade5de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.854342:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940877.854344:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940877.854346:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940877.854591:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17175:x1875839944967040:12345-0@lo:5:osp-pre-0-0.0 Request processed in 115425us (118822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940877.854603:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940877.854700:0:17175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17175:1875839944967040:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788940877.854718:0:17175:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1788940877.854771:0:17175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17175:1875839944967168:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788940877.854810:0:17175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940877.854845:0:17175:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d030d496c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940877.854892:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944967168 00000100:00100000:0.0:1788940877.854900:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944967168 00000100:00100000:0.0:1788940877.854944:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788940877.854952:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17175:x1875839944967168:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788940877.854987:0:18670:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1788940877.863586:0:18664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1788940877.864557:0:18664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788940877.865858:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17175:x1875839944967168:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10899us (11040us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788940877.865871:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940877.866172:0:17175:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788940877.866181:0:17175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17175:1875839944967168:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788940877.866208:0:17175:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1788940878.686301:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940879.707490:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940880.027499:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944967296:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788940880.027560:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940880.029143:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944967424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940880.029205:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940880.032795:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940880.032836:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944967552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940880.032909:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940880.032965:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944967296 00000100:00100000:0.0:1788940880.032973:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944967296 00000100:00100000:0.0:1788940880.033029:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944967552 00000100:00100000:0.0:1788940880.033033:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944967552 00000100:00100000:0.0:1788940880.033049:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788940880.033057:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944967296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788940880.033092:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788940880.033211:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788940880.033222:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944967552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940880.033249:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788940880.033303:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944967552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940880.033311:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788940880.033337:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944967424 00000100:00100000:2.0:1788940880.033340:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944967424 00000100:00100000:2.0:1788940880.033383:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940880.033389:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944967424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788940880.033408:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788940880.033455:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944967424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (4249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940880.033462:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940880.033528:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944967424:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788940880.039583:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940880.039899:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944967296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6837us (12331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940880.039913:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788940880.040082:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944967552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788940880.044106:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf079e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944967296:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788940880.731915:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788940881.704546:0:19483:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788940881.704550:0:19483:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788940881.704552:0:19483:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788940881.704705:0:19483:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91cf0632d000 00000020:01000004:2.0:1788940881.704721:0:19483:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788940881.704746:0:19483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788940881.704766:0:19483:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91cf06320000) 00000020:00000080:2.0:1788940881.705177:0:19483:0:(obd_config.c:786:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1788940881.763463:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788940881.818584:0:19483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788940881.827868:0:19483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788940881.828733:0:19483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788940881.829019:0:19483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788940881.829291:0:19483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788940881.829587:0:19483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788940881.829780:0:19483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1788940881.843977:0:19483:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788940881.844303:0:19483:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788940881.845523:0:19483:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788940881.845545:0:19483:0:(genops.c:1393:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9c34acc08bade5ec 00000020:01000004:3.0:1788940881.845554:0:19483:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788940881.845583:0:19483:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.125@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788940881.845587:0:19483:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788940881.845594:0:19483:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788940881.845634:0:19483:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788940881.845639:0:19483:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788940881.882480:0:19483:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788940881.882524:0:19483:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.125@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788940881.882529:0:19483:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788940881.882536:0:19483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788940881.882537:0:19483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940881.882538:0:19483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940881.882540:0:19483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940881.882541:0:19483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940881.882543:0:19483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940881.882545:0:19483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940881.882546:0:19483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940881.882550:0:19483:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788940881.882552:0:19483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940881.882554:0:19483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788940881.882555:0:19483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940881.882556:0:19483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940881.882557:0:19483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940881.882558:0:19483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940881.882559:0:19483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940881.882561:0:19483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940881.882562:0:19483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940881.882588:0:19483:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788940881.882610:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944967680:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788940881.882690:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940881.882804:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00c89c9c0 going to sleep for 11 seconds 00000040:00080000:3.0:1788940881.887723:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788940881.895390:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944967680 00000100:00100000:1.0:1788940881.895410:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944967680 00000100:00100000:1.0:1788940881.895490:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788940881.895502:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d36e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:19483:x1875839944967680:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788940881.895595:0:17145:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788940881.895598:0:17145:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788940881.895603:0:17145:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788940881.896000:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d36e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:19483:x1875839944967680:12345-0@lo:253:mount.lustre.0 Request processed in 498us (13308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940881.896009:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788940881.896106:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944967680:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788940881.896117:0:19483:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788940881.896119:0:19483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788940881.896121:0:19483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788940881.896122:0:19483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940881.896122:0:19483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940881.896123:0:19483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940881.896125:0:19483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940881.896126:0:19483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940881.896127:0:19483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940881.896128:0:19483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788940881.896156:0:19483:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91cf0632d000 from lustre-OST0001 10000000:01000000:2.0:1788940881.896180:0:19483:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788940881.896182:0:19483:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788940881.896191:0:19483:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91cf07a04d88 local copy 00010000:00010000:2.0:1788940881.896208:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade249 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940881.896322:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944967808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940881.896352:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940881.896389:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00c89c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940881.896591:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944967808 00000100:00100000:3.0:1788940881.896596:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944967808 00000100:00100000:3.0:1788940881.896634:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788940881.896642:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:19483:x1875839944967808:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940881.896824:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:19483:x1875839944967808:12345-0@lo:501:mount.lustre.0 Request processed in 182us (470us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788940881.896831:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788940881.896948:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944967808:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788940881.896963:0:19483:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788940881.897056:0:19483:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788940881.897063:0:19483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade249 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940881.897074:0:19483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade249 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940881.897100:0:19483:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91cf0632d000 10000000:01000000:2.0:1788940881.897105:0:19483:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788940881.897110:0:19483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788940881.897113:0:19483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788940881.897117:0:19483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788940881.897120:0:19483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788940881.897141:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e6c00/0x9c34acc08bade5f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940881.897210:0:19483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d0355e6c00/0x9c34acc08bade5f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940881.897221:0:19483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d0355e6c00/0x9c34acc08bade5f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940881.897248:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944967936:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788940881.897928:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940881.897968:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00c89c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940881.898080:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944967936 00000100:00100000:1.0:1788940881.898086:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944967936 00000100:00100000:1.0:1788940881.898133:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788940881.898142:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:19483:x1875839944967936:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940881.898249:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940881.898336:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d004602e00/0x9c34acc08bade5fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade5f3 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940881.898363:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d004602e00/0x9c34acc08bade5fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade5f3 expref: 22 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940881.898374:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d004602e00/0x9c34acc08bade5fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade5f3 expref: 22 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940881.898382:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602e00, rc 0) 00000100:00100000:1.0:1788940881.898478:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:19483:x1875839944967936:12345-0@lo:101:mount.lustre.0 Request processed in 337us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940881.898485:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788940881.898591:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944967936:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940881.898608:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d0355e6c00/0x9c34acc08bade5f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade5fa expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940881.898617:0:19483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d0355e6c00/0x9c34acc08bade5f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade5fa expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788940881.901060:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788940881.902768:0:19483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940881.906617:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788940881.907712:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788940881.907752:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788940881.907774:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788940881.907789:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788940881.907802:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788940881.907899:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788940881.907906:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788940881.908031:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944968064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940881.908099:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940881.908150:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039053c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940881.908364:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944968064 00000100:00100000:1.0:1788940881.908372:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944968064 00000100:00100000:1.0:1788940881.908437:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788940881.908447:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d36dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:19483:x1875839944968064:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940881.908617:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d36dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:19483:x1875839944968064:12345-0@lo:501:mount.lustre.0 Request processed in 171us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940881.908626:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788940881.908649:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944968064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940881.908682:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944968192:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788940881.908723:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940881.908793:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039053c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940881.908879:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944968192 00000100:00100000:1.0:1788940881.908884:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944968192 00000100:00100000:1.0:1788940881.908915:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788940881.908922:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d36d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:19483:x1875839944968192:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940881.910245:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d36d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:19483:x1875839944968192:12345-0@lo:503:mount.lustre.0 Request processed in 1319us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940881.910253:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788940881.910481:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944968192:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788940881.910932:0:19483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788940881.910995:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944968320:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940881.911032:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940881.911064:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039053600 going to sleep for 11 seconds 00000100:00100000:1.0:1788940881.911076:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944968320 00000100:00100000:1.0:1788940881.911082:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944968320 00000100:00100000:1.0:1788940881.911122:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788940881.911130:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d36e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:19483:x1875839944968320:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940881.911951:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d36e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:19483:x1875839944968320:12345-0@lo:502:mount.lustre.0 Request processed in 815us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940881.911961:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788940881.911978:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944968320:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788940881.912111:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788940881.912131:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788940881.912141:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788940881.912614:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788940881.912639:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788940881.912653:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788940881.912678:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788940881.912693:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788940881.912734:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788940881.912768:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944968448:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940881.912825:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940881.912856:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039053600 going to sleep for 11 seconds 00000100:00100000:1.0:1788940881.913288:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944968448 00000100:00100000:1.0:1788940881.913294:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944968448 00000100:00100000:1.0:1788940881.913330:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788940881.913337:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00ddca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:19483:x1875839944968448:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940881.913431:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00ddca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:19483:x1875839944968448:12345-0@lo:502:mount.lustre.0 Request processed in 85us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940881.913439:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788940881.913761:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944968448:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788940881.913881:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788940881.913890:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788940881.914526:0:19487:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788940881.914533:0:19487:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788940881.914538:0:19487:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940881.914593:0:19487:0:(obd_config.c:1662:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788940881.914601:0:19487:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788940881.914616:0:19487:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001 (ffff91d0050e0000) 00000020:00000080:1.0:1788940881.914642:0:19487:0:(obd_config.c:786:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788940881.914718:0:19487:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788940881.914769:0:19487:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91cf0632d000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788940881.914774:0:19487:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788940881.914780:0:19487:0:(genops.c:1393:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9c34acc08bade608 00010000:00010000:1.0:1788940881.919220:0:19487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788940881.925174:0:19487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1788940881.927706:0:19487:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788940881.931453:0:19487:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788940881.931465:0:19487:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940881.931472:0:19487:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940881.931474:0:19487:0:(obd_config.c:1662:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788940881.931478:0:19487:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940881.931482:0:19487:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940881.931483:0:19487:0:(obd_config.c:1662:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788940881.931487:0:19487:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788940881.931489:0:19487:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788940881.931491:0:19487:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940881.931493:0:19487:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940881.931495:0:19487:0:(obd_config.c:1662:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788940881.931497:0:19487:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940881.931500:0:19487:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940881.931501:0:19487:0:(obd_config.c:1662:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788940881.931505:0:19487:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788940881.931537:0:19487:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940881.931540:0:19487:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940881.931541:0:19487:0:(obd_config.c:1662:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788940881.931544:0:19487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788940881.942970:0:19483:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788940881.943018:0:19483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788940881.943041:0:19483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e6c00/0x9c34acc08bade5f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade5fa expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940881.943054:0:19483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d0355e6c00/0x9c34acc08bade5f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade5fa expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940881.943062:0:19483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91cf0632d000 from 1 10000000:01000000:3.0:1788940881.943065:0:19483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788940881.943101:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08bade60f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940881.943109:0:19483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08bade60f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940881.943120:0:19483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08bade60f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940881.943161:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944968576:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788940881.943397:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940881.943441:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944968576 00000100:00100000:3.0:1788940881.943449:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039053600 going to sleep for 11 seconds 00000100:00100000:1.0:1788940881.943449:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944968576 00000100:00100000:1.0:1788940881.943504:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788940881.943514:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:19483:x1875839944968576:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940881.943528:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940881.943547:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d004602000/0x9c34acc08bade616 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade60f expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940881.943570:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d004602000/0x9c34acc08bade616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade60f expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940881.943582:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d004602000/0x9c34acc08bade616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade60f expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940881.943590:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602000, rc 0) 00000100:00100000:1.0:1788940881.943641:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:19483:x1875839944968576:12345-0@lo:101:mount.lustre.0 Request processed in 128us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940881.943648:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788940881.943991:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944968576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940881.944008:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08bade60f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade616 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940881.944017:0:19483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08bade60f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade616 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788940881.946585:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788940881.946887:0:19483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940881.947159:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788940881.947187:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788940881.947211:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788940881.947218:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788940881.947339:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944968704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940881.947417:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940881.947480:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944968704 00000100:00100000:0.0:1788940881.947480:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d030d49e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940881.947490:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944968704 00000100:00100000:2.0:1788940881.947537:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788940881.947547:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:19483:x1875839944968704:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940881.947671:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:19483:x1875839944968704:12345-0@lo:501:mount.lustre.0 Request processed in 125us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940881.947679:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788940881.948123:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944968704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940881.948161:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944968832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940881.948227:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940881.948250:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d030d49e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940881.948311:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944968832 00000100:00100000:3.0:1788940881.948317:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944968832 00000100:00100000:3.0:1788940881.948346:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788940881.948354:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:19483:x1875839944968832:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788940881.948468:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:19483:x1875839944968832:12345-0@lo:503:mount.lustre.0 Request processed in 113us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940881.948475:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788940881.948710:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944968832:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788940881.949420:0:19483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788940881.949510:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944968960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940881.949558:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940881.949594:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d030d49e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940881.951120:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944968960 00000100:00100000:1.0:1788940881.951143:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944968960 00000100:00100000:1.0:1788940881.951200:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788940881.951210:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:19483:x1875839944968960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940881.951399:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:19483:x1875839944968960:12345-0@lo:502:mount.lustre.0 Request processed in 190us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940881.951406:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788940881.951436:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944968960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788940881.951664:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788940881.951697:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788940881.951711:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788940881.951724:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788940881.951736:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788940881.951749:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788940881.951761:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788940881.951774:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788940881.951786:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788940881.951800:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788940881.951814:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788940881.951938:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944969088:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940881.952063:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940881.952229:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d030d49e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940881.955971:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944969088 00000100:00100000:1.0:1788940881.956057:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944969088 00000100:00100000:1.0:1788940881.956178:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788940881.956191:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:19483:x1875839944969088:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940881.956409:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:19483:x1875839944969088:12345-0@lo:502:mount.lustre.0 Request processed in 221us (4348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940881.956418:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788940881.956669:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944969088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788940881.956776:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788940881.956790:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788940881.961694:0:19491:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940881.961721:0:19491:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940881.961723:0:19491:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788940881.961731:0:19491:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91cf0632d000 00000020:00000080:1.0:1788940881.961734:0:19491:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788940881.961742:0:19491:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940881.961745:0:19491:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940881.961747:0:19491:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788940881.961749:0:19491:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940881.961751:0:19491:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940881.961754:0:19491:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788940881.961757:0:19491:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91cf0632d000 00000020:00000080:1.0:1788940881.961760:0:19491:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788940881.961834:0:19491:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940881.961838:0:19491:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940881.961839:0:19491:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788940881.961842:0:19491:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940881.961844:0:19491:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940881.961845:0:19491:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788940881.961849:0:19491:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91cf0632d000 00000020:00000080:1.0:1788940881.961851:0:19491:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788940881.961871:0:19491:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940881.961873:0:19491:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940881.961875:0:19491:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788940881.961877:0:19491:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940881.961879:0:19491:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940881.961881:0:19491:0:(obd_config.c:1662:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788940881.961884:0:19491:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91cf0632d000 00000020:00000080:1.0:1788940881.961886:0:19491:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788940881.961908:0:19491:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940881.961911:0:19491:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940881.961913:0:19491:0:(obd_config.c:1662:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788940881.961916:0:19491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788940881.963112:0:19483:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788940881.963148:0:19483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940881.963181:0:19483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08bade60f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade616 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940881.963193:0:19483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08bade60f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade616 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940881.963652:0:19483:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788940881.963655:0:19483:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91cf0632d000 10000000:01000000:1.0:1788940881.963658:0:19483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91cf0632d000 10000000:01000000:1.0:1788940881.963662:0:19483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788940881.963667:0:19483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91cf0632d000 from 1 10000000:01000000:1.0:1788940881.963671:0:19483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788940881.963709:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603a00/0x9c34acc08bade61d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940881.963718:0:19483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d004603a00/0x9c34acc08bade61d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940881.963729:0:19483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d004603a00/0x9c34acc08bade61d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940881.963755:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944969216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940881.964932:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940881.965418:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944969216 00000100:00100000:2.0:1788940881.965438:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944969216 00000100:00100000:2.0:1788940881.965505:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788940881.965515:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:19483:x1875839944969216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940881.965532:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940881.965547:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0355e7200/0x9c34acc08bade624 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade61d expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940881.965572:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0355e7200/0x9c34acc08bade624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade61d expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940881.965584:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0355e7200/0x9c34acc08bade624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade61d expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940881.965594:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0355e7200, rc 0) 00000100:00100000:2.0:1788940881.965649:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:19483:x1875839944969216:12345-0@lo:101:mount.lustre.0 Request processed in 135us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940881.965656:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788940881.965808:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00bca9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940881.965922:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944969216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940881.965940:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d004603a00/0x9c34acc08bade61d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade624 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940881.965951:0:19483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d004603a00/0x9c34acc08bade61d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade624 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788940881.971503:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1788940881.972059:0:19483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940881.977027:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788940881.977088:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788940881.977108:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788940881.977126:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788940881.977143:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788940881.977158:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788940881.977172:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788940881.977185:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788940881.977200:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788940881.977213:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788940881.977226:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788940881.977240:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788940881.977252:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788940881.977287:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788940881.977303:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788940881.977317:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788940881.977332:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788940881.977346:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788940881.977361:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788940881.977396:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788940881.977414:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788940881.977443:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788940881.977470:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788940881.977488:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788940881.977503:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788940881.977518:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788940881.977533:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788940881.977548:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788940881.977562:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788940881.977577:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788940881.977588:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788940881.977599:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788940881.977611:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788940881.977622:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788940881.977633:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788940881.977661:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788940881.977674:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788940881.977686:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788940881.977698:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1788940881.977711:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1788940881.977726:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1788940881.977738:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1788940881.977748:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1788940881.977760:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1788940881.977772:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1788940881.977784:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1788940881.981902:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1788940881.981948:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1788940881.982080:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944969344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940881.982153:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940881.982212:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0390539c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940881.982497:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944969344 00000100:00100000:0.0:1788940881.982508:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944969344 00000100:00100000:0.0:1788940881.982565:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788940881.982576:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:19483:x1875839944969344:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940881.982730:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:19483:x1875839944969344:12345-0@lo:501:mount.lustre.0 Request processed in 155us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940881.982738:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788940881.983755:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944969344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940881.983804:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944969472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788940881.983886:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940881.983924:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0390539c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940881.984029:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944969472 00000100:00100000:2.0:1788940881.984035:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944969472 00000100:00100000:2.0:1788940881.984194:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788940881.984204:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:19483:x1875839944969472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940881.984349:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:19483:x1875839944969472:12345-0@lo:503:mount.lustre.0 Request processed in 146us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940881.984357:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788940881.987889:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944969472:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788940881.988433:0:19483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788940881.988523:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944969600:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940881.988611:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940881.991784:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00bca9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940881.994396:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944969600 00000100:00100000:0.0:1788940881.994413:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944969600 00000100:00100000:0.0:1788940881.994520:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788940881.994531:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:19483:x1875839944969600:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940881.994942:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:19483:x1875839944969600:12345-0@lo:502:mount.lustre.0 Request processed in 411us (6330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940881.994949:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788940881.995064:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944969600:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788940881.995346:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788940881.995377:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788940881.995392:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788940881.995404:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788940881.995416:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788940881.997628:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788940881.997675:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788940881.997693:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788940881.997706:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788940881.997718:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788940881.997732:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788940881.997745:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788940881.997757:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788940881.997771:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788940881.997785:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788940881.997803:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788940881.998031:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788940881.998047:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788940881.998061:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788940881.998073:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788940881.998085:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788940881.998097:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788940881.998111:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788940881.998126:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788940881.998139:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1788940881.998153:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1788940881.998167:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1788940881.998178:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1788940881.998191:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1788940881.998204:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1788940881.998216:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1788940881.998229:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788940881.999722:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788940881.999771:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788940881.999788:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788940881.999801:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788940882.001608:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788940882.001668:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788940882.001685:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788940882.001697:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788940882.001709:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788940882.001721:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788940882.001733:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788940882.001745:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788940882.001765:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788940882.001779:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788940882.001791:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788940882.002232:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788940882.002943:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944969728:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940882.003033:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940882.003118:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a4a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788940882.004003:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944969728 00000100:00100000:2.0:1788940882.004013:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944969728 00000100:00100000:1.0:1788940882.007513:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788940882.009458:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:19483:x1875839944969728:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940882.009666:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:19483:x1875839944969728:12345-0@lo:502:mount.lustre.0 Request processed in 2139us (6632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940882.009677:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788940882.009875:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944969728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788940882.010115:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788940882.010653:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788940882.010703:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944969856:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940882.010758:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940882.010794:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039053540 going to sleep for 11 seconds 00000100:00100000:1.0:1788940882.010919:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944969856 00000100:00100000:1.0:1788940882.010926:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944969856 00000100:00100000:1.0:1788940882.010973:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788940882.010982:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:19483:x1875839944969856:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940882.011074:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:19483:x1875839944969856:12345-0@lo:502:mount.lustre.0 Request processed in 93us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940882.011083:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788940882.012357:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944969856:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788940882.012449:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788940882.012461:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788940882.016797:0:19496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788940882.016830:0:19496:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91d03ec5b3b0) 00000020:00000080:3.0:1788940882.016858:0:19496:0:(obd_config.c:786:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788940882.016955:0:19496:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91cf0632d000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788940882.016960:0:19496:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91cf0632d000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788940882.016963:0:19496:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91cf0632d000 3 00010000:00080000:3.0:1788940882.016995:0:19496:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91cf08f38800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.125@tcp at head 00010000:00010000:3.0:1788940882.028191:0:19496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788940882.034947:0:19496:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788940882.035002:0:19496:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788940882.035016:0:19496:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9c34acc08bade632 00000100:00080000:1.0:1788940882.035027:0:19496:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788940882.035034:0:19496:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91cf08f38800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940882.035071:0:19496:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d020c8d180 x1875839944969984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940882.035098:0:19496:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788940882.035373:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875839944969984:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788940882.036776:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940882.036860:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944969984 00000100:00100000:3.0:1788940882.036868:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944969984 00000100:00100000:3.0:1788940882.036905:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940882.036913:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1875839944969984:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788940882.036941:0:17151:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 637 last 0 00000020:00000080:3.0:1788940882.036988:0:17151:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9c34acc08bade639 00000004:00100000:3.0:1788940882.037003:0:17151:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788940882.037036:0:17151:0:(import.c:65:import_set_state_nolock()) ffff91cf08f3e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940882.037089:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875839944969984:12345-0@lo:38:llog_process_th.0 Request processed in 176us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940882.037096:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788940882.037137:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d020c8d180 x1875839944969984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940882.037147:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788940882.037155:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788940882.037164:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788940882.037169:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788940882.037171:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf08f38800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788940882.037177:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875839944969984:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1788940882.037316:0:19496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788940882.037331:0:19496:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff91d03ec5cd88) 00000020:00000080:3.0:1788940882.037352:0:19496:0:(obd_config.c:786:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788940882.037457:0:19496:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91cf0632d000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788940882.037461:0:19496:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91cf0632d000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788940882.037464:0:19496:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91cf0632d000 3 00010000:00080000:3.0:1788940882.037490:0:19496:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91cf01631800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.125@tcp at head 00000100:00080000:2.0:1788940882.039955:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940882.039962:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788940882.039966:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d03ed25000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940882.039974:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 633 00000100:00080000:2.0:1788940882.039979:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788940882.039985:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d03ed25000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788940882.040005:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d018b0ad80 x1875839944970368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788940882.040053:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940882.040056:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788940882.040058:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d02e8ea000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940882.040062:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 633 00000100:00080000:2.0:1788940882.040064:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788940882.040067:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91d02e8ea000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788940882.040078:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d018b09500 x1875839944970880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940882.040125:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944970624:0@lo:400:kworker.0 00000100:00100000:2.0:1788940882.040193:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940882.040226:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944971264:0@lo:400:kworker.0 00000100:00100000:2.0:1788940882.040255:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940882.040299:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788940882.040305:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944970112:0@lo:400:kworker.0 00000100:00100000:2.0:1788940882.040344:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940882.040361:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944970752:0@lo:400:kworker.0 00000100:00100000:2.0:1788940882.040384:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940882.040413:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944970240:0@lo:400:kworker.0 00000100:00100000:2.0:1788940882.040463:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940882.040488:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944971008:0@lo:400:kworker.0 00000100:00100000:2.0:1788940882.040508:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940882.040528:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788940882.040533:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944970496:0@lo:400:kworker.0 00000100:00100000:2.0:1788940882.040576:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940882.040595:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944971136:0@lo:400:kworker.0 00000100:00100000:2.0:1788940882.040614:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940882.040642:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944970368:0@lo:8:kworker.0 00000100:00100000:2.0:1788940882.040691:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940882.040709:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944970880:0@lo:8:kworker.0 00000100:00100000:2.0:1788940882.040732:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940882.040766:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944970624 00000100:00100000:2.0:1788940882.040774:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944970624 00000100:00100000:2.0:1788940882.040812:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944970112 00000100:00100000:2.0:1788940882.040816:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944970112 00000100:00100000:2.0:1788940882.040832:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788940882.040841:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944970624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940882.040892:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944970624:12345-0@lo:400:kworker.0 Request processed in 51us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940882.040899:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788940882.040915:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788940882.040921:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944970112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940882.040948:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944970112:12345-0@lo:400:kworker.0 Request processed in 27us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940882.040954:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788940882.040962:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944970752 00000100:00100000:0.0:1788940882.040967:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944970752 00000100:00100000:2.0:1788940882.040974:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944971264 00000100:00100000:2.0:1788940882.040976:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944971264 00000100:00100000:2.0:1788940882.040996:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944971008 00000100:00100000:0.0:1788940882.040996:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944970240 00000100:00100000:2.0:1788940882.040999:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944971008 00000100:00100000:0.0:1788940882.040999:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944970240 00000100:00100000:2.0:1788940882.041008:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944970496 00000100:00100000:2.0:1788940882.041010:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944970496 00000100:00100000:0.0:1788940882.041010:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944970368 00000100:00100000:0.0:1788940882.041012:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944970368 00000100:00100000:0.0:1788940882.041020:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944970880 00000100:00100000:0.0:1788940882.041022:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944970880 00000100:00100000:2.0:1788940882.041028:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944971136 00000100:00100000:2.0:1788940882.041030:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944971136 00000100:00100000:0.0:1788940882.041031:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940882.041036:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944970752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940882.041042:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788940882.041047:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944971264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940882.041071:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944970752:12345-0@lo:400:kworker.0 Request processed in 35us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940882.041072:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944971264:12345-0@lo:400:kworker.0 Request processed in 25us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940882.041077:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940882.041078:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788940882.041088:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788940882.041088:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940882.041093:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944971008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940882.041093:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944970240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940882.041416:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944971008:12345-0@lo:400:kworker.0 Request processed in 29us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940882.041433:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788940882.041446:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788940882.041453:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944970496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940882.043332:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944970240:12345-0@lo:400:kworker.0 Request processed in 2231us (2860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940882.043344:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940882.043372:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940882.043378:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1875839944970368:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788940882.043462:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1875839944970368:12345-0@lo:8:kworker.0 Request processed in 82us (2770us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788940882.043468:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940882.043481:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940882.043491:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1875839944970880:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788940882.043524:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1875839944970880:12345-0@lo:8:kworker.0 Request processed in 33us (2791us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788940882.043529:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788940882.043563:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940882.043567:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788940882.043570:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940882.043598:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788940882.043605:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03ed25000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940882.043609:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788940882.043613:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944970368:0@lo:8:kworker.0 00000100:00100000:0.0:1788940882.043623:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788940882.043626:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02e8ea000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940882.043629:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788940882.043631:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944970880:0@lo:8:kworker.0 00010000:00010000:3.0:1788940882.050473:0:19496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788940882.050703:0:19496:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788940882.050750:0:19496:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788940882.050763:0:19496:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x9c34acc08bade647 00000100:00080000:3.0:1788940882.050772:0:19496:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788940882.050779:0:19496:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff91cf01631800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940882.050820:0:19496:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf07846a00 x1875839944971392/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788940882.050850:0:19496:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788940882.050895:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875839944971392:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788940882.050964:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940882.051509:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944970496:12345-0@lo:400:kworker.0 Request processed in 10053us (10928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940882.051521:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788940882.051553:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944971392 00000100:00100000:2.0:1788940882.051559:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944971392 00000100:00100000:2.0:1788940882.051579:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940882.051589:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944971136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940882.051631:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944971136:12345-0@lo:400:kworker.0 Request processed in 46us (11017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940882.051637:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940882.051648:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940882.051652:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875839944971392:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788940882.051683:0:17152:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 637 last 0 00000020:00000080:2.0:1788940882.051713:0:17152:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x9c34acc08bade64e 00000004:00100000:2.0:1788940882.051726:0:17152:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788940882.051754:0:17152:0:(import.c:65:import_set_state_nolock()) ffff91cf07e09000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940882.051798:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875839944971392:12345-0@lo:38:llog_process_th.0 Request processed in 145us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940882.051804:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788940882.051818:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf07846a00 x1875839944971392/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940882.051829:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788940882.051836:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788940882.051842:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788940882.051846:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788940882.051849:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf01631800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788940882.051851:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944970112:0@lo:400:kworker.0 00000100:00100000:0.0:1788940882.051854:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875839944971392:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788940882.051863:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944970752:0@lo:400:kworker.0 00000100:00100000:2.0:1788940882.051873:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944970624:0@lo:400:kworker.0 00010000:00080000:2.0:1788940882.051884:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d018b0aa00 x1875839944971264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940882.051894:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944971264:0@lo:400:kworker.0 00010000:00080000:2.0:1788940882.051932:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d018b09c00 x1875839944970496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940882.051940:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944970496:0@lo:400:kworker.0 00010000:00080000:2.0:1788940882.051949:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d018b08a80 x1875839944971136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940882.051957:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944971136:0@lo:400:kworker.0 00000100:00100000:2.0:1788940882.051968:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944970240:0@lo:400:kworker.0 00010000:00080000:2.0:1788940882.051980:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d018b09880 x1875839944971008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940882.051998:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944971008:0@lo:400:kworker.0 00000040:00080000:3.0:1788940882.055497:0:19496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788940882.055787:0:19483:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788940882.055823:0:19483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788940882.055847:0:19483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603a00/0x9c34acc08bade61d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade624 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940882.055860:0:19483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d004603a00/0x9c34acc08bade61d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade624 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788940882.055925:0:19483:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788940882.055927:0:19483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788940882.055928:0:19483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940882.055930:0:19483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940882.055931:0:19483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940882.055932:0:19483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940882.055934:0:19483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940882.055936:0:19483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940882.055937:0:19483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788940882.055941:0:19483:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788940882.055944:0:19483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940882.055945:0:19483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788940882.055946:0:19483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940882.055947:0:19483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940882.055948:0:19483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940882.055949:0:19483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940882.055950:0:19483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940882.055952:0:19483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940882.055953:0:19483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788940882.055980:0:19483:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788940882.056001:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944971520:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788940882.056071:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940882.056105:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02004fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940882.057181:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944971520 00000100:00100000:1.0:1788940882.057193:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944971520 00000100:00100000:1.0:1788940882.057408:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788940882.057419:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:19483:x1875839944971520:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788940882.057461:0:17144:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788940882.057477:0:17144:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788940882.060717:0:17144:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788940882.060784:0:17144:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788940882.061782:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:19483:x1875839944971520:12345-0@lo:253:mount.lustre.0 Request processed in 4358us (5704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940882.061796:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788940882.062479:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:303c4994-a6d4-4c7c-823f-eb7dad50725e:19483:1875839944971520:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788940882.062496:0:19483:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788940882.062499:0:19483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788940882.062501:0:19483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788940882.062502:0:19483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940882.062503:0:19483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940882.062504:0:19483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940882.062506:0:19483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940882.062507:0:19483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788940882.062509:0:19483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940882.062511:0:19483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788940882.062525:0:19483:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788940882.065761:0:17166:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788940882.065775:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788940882.065916:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d001218e00/0x9c34acc08bade655 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940882.065936:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade4fe expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940882.065945:0:17166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade50c expref: 23 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940882.065953:0:17166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d001218e00/0x9c34acc08bade655 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940882.065992:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08bade50c expref: 23 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940882.066008:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade513 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08bade50c expref: 23 pid: 17143 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940882.066031:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875839944971648:0@lo:104: 00000100:00100000:3.0:1788940882.066093:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940882.066144:0:17166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08bade4fe expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940882.066153:0:17166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade505 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08bade4fe expref: 23 pid: 17145 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940882.066161:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875839944971776:0@lo:104: 00000100:00100000:3.0:1788940882.066182:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940882.066207:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944971648 00000100:00100000:3.0:1788940882.066214:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944971648 00000100:00100000:3.0:1788940882.066247:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944971776 00000100:00100000:3.0:1788940882.066250:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944971776 00000100:00100000:3.0:1788940882.066298:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940882.066307:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+4:17166:x1875839944971648:12345-0@lo:104: 00000001:00000004:2.0:1788940882.066768:0:19483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1788940882.067439:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade50c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade513 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940882.067503:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940882.067512:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+4:17166:x1875839944971648:12345-0@lo:104: Request processed in 1204us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940882.067521:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788940882.067758:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940882.067765:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade50c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade513 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940882.067773:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603c00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940882.067777:0:18693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade50c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08bade513 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940882.067786:0:18693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade50c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08bade513 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940882.067793:0:18693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade50c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08bade513 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940882.067799:0:18693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940882.067844:0:18693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade50c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade513 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940882.067850:0:18693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940882.067876:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade50c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade513 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940882.067883:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade50c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade513 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940882.067898:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940882.067900:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940882.067901:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940882.067909:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940882.067929:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944971904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940882.067965:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940882.068028:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788940882.068039:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07847480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+3:17166:x1875839944971776:12345-0@lo:104: 00010000:00010000:3.0:1788940882.068049:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade4fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade505 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940882.068104:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940882.068110:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07847480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+3:17166:x1875839944971776:12345-0@lo:104: Request processed in 74us (1927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940882.068115:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788940882.068139:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf01723e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940882.068161:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875839944971648:0@lo:104: 00000100:00100000:3.0:1788940882.068170:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17166:1875839944971776:0@lo:104: 00010000:00010000:3.0:1788940882.068186:0:17166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d001218e00/0x9c34acc08bade655 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940882.068399:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940882.068405:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade4fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade505 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940882.068412:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602c00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940882.068416:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade4fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08bade505 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940882.068433:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade4fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08bade505 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940882.068440:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade4fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08bade505 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940882.068445:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940882.068501:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade4fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade505 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940882.068507:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940882.068523:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade4fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade505 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940882.068529:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade4fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade505 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940882.068559:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940882.068561:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940882.068563:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940882.068574:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944972032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940882.068610:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940882.069292:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944971904 00000100:00100000:0.0:1788940882.069302:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944971904 00010000:00010000:0.0:1788940882.069331:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade513 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade50c expref: 24 pid: 17143 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940882.069357:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944972032 00000100:00100000:0.0:1788940882.069360:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944972032 00010000:00010000:0.0:1788940882.069371:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade505 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade4fe expref: 25 pid: 17145 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940882.069384:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788940882.069391:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:303c4994-a6d4-4c7c-823f-eb7dad50725e+25:3645:x1875839944971904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940882.069402:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940882.069407:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade513 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade50c expref: 25 pid: 17143 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940882.069418:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08bade50c expref: 25 pid: 17143 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940882.069925:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584ce00/0x9c34acc08bade513 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08bade50c expref: 25 pid: 17143 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940882.069941:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940882.070001:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3645:x1875839944971904:12345-0@lo:103:ldlm_bl.0 Request processed in 610us (2036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940882.070008:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788940882.070026:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788940882.070033:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:3647:x1875839944972032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940882.070041:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940882.070054:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade505 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade4fe expref: 23 pid: 17145 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940882.070063:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08bade4fe expref: 23 pid: 17145 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940882.070072:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0355e7600/0x9c34acc08bade505 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08bade4fe expref: 23 pid: 17145 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940882.070083:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d001218e00/0x9c34acc08bade655 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940882.070090:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001218e00/0x9c34acc08bade655 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788940882.070105:0:17137:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005969160s 00010000:00010000:0.0:1788940882.070110:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d001218e00/0x9c34acc08bade655 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940882.070116:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d001218e00/0x9c34acc08bade655 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940882.070123:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d001218e00/0x9c34acc08bade655 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940882.070129:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d001218e00/0x9c34acc08bade655 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940882.071252:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218e00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940882.071273:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d001218e00/0x9c34acc08bade655 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940882.071303:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d001218e00/0x9c34acc08bade655 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940882.071322:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d001218e00/0x9c34acc08bade655 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940882.071335:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940882.071399:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:3647:x1875839944972032:12345-0@lo:103:ldlm_bl.0 Request processed in 1364us (2786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940882.071408:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788940882.073000:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944971904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940882.073006:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944972032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940882.073050:0:17166:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d001218e00/0x9c34acc08bade655 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940882.073061:0:17166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d001218e00/0x9c34acc08bade655 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940882.073068:0:17166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d001218e00/0x9c34acc08bade655 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788940882.075190:0:19483:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788940882.075200:0:19483:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788940882.075243:0:19483:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788940882.075314:0:19483:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788940882.075342:0:19483:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788940882.075368:0:19483:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788940882.078126:0:19483:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788940882.078695:0:19483:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788940882.792738:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940883.102104:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940883.102129:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944972160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940883.102305:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940883.102357:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944972160 00000100:00100000:2.0:1788940883.102366:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944972160 00000100:00100000:2.0:1788940883.102427:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940883.102438:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944972160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940883.103098:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788940883.103243:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944972160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 805us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940883.103252:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940883.103334:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944972160:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1788940883.164324:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788940883.164332:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d03547c000 from 10 10000000:01000000:1.0:1788940883.164337:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788940883.164439:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade65c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940883.164452:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade65c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940883.164465:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade65c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940883.164492:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944972288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788940883.164577:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940883.164627:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c306c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940883.164700:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944972288 00000100:00100000:3.0:1788940883.164709:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944972288 00000100:00100000:3.0:1788940883.164768:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788940883.164779:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:17147:x1875839944972288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940883.164793:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940883.164825:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d001218e00/0x9c34acc08bade663 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade65c expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940883.164848:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001218e00/0x9c34acc08bade663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade65c expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940883.164860:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d001218e00/0x9c34acc08bade663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade65c expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940883.164870:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001218e00, rc 0) 00000100:00100000:3.0:1788940883.164922:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:17147:x1875839944972288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940883.164941:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788940883.165232:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944972288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940883.165249:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade65c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade663 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940883.165280:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade65c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade663 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940883.165338:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944972416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788940883.165375:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940883.165427:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c306c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940883.165475:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944972416 00000100:00100000:3.0:1788940883.165480:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944972416 00000100:00100000:3.0:1788940883.165517:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788940883.165524:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:17147:x1875839944972416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788940883.165540:0:17144:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788940883.165557:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788940883.165560:0:17144:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788940883.165631:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:17147:x1875839944972416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940883.165639:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788940883.165713:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944972416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788940883.165786:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788940883.165795:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade65c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade663 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940883.165925:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade663 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940883.165938:0:17147:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788940883.165940:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91cf08ce7800 from 10 10000000:01000000:1.0:1788940883.165943:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788940883.165966:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade66a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940883.165974:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade66a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940883.165982:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade66a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940883.166073:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944972544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788940883.166105:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940883.167016:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c306c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940883.171315:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944972544 00000100:00100000:3.0:1788940883.171329:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944972544 00000100:00100000:3.0:1788940883.171385:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788940883.171396:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:17147:x1875839944972544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940883.171426:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940883.171448:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d001218200/0x9c34acc08bade671 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade66a expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940883.171478:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001218200/0x9c34acc08bade671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade66a expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940883.171490:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d001218200/0x9c34acc08bade671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade66a expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940883.171498:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001218200, rc 0) 00000100:00100000:3.0:1788940883.171576:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:17147:x1875839944972544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (5469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940883.171595:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788940883.171667:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944972544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940883.171689:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade66a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade671 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940883.171699:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade66a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade671 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940883.171765:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944972672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788940883.171915:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940883.171949:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf017230c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940883.171963:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944972672 00000100:00100000:3.0:1788940883.171967:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944972672 00000100:00100000:3.0:1788940883.172054:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788940883.172062:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:17147:x1875839944972672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788940883.172078:0:17144:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788940883.172095:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788940883.172098:0:17144:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788940883.172176:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:17147:x1875839944972672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940883.172183:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788940883.172215:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944972672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788940883.172306:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788940883.172314:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade66a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade671 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940883.172332:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade66a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade671 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:3.0:1788940883.217141:0:19549:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788940883.217690:0:19549:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788940883.803449:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940884.827488:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940885.147466:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940885.147492:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944972800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940885.147611:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940885.147743:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944972800 00000100:00100000:0.0:1788940885.147752:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944972800 00000100:00100000:0.0:1788940885.147810:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788940885.147820:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944972800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788940885.147856:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788940885.147905:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944972800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940885.147913:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788940885.149655:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944972928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940885.149721:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940885.149781:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944972800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940885.149821:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944972928 00000100:00100000:3.0:1788940885.149828:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944972928 00000100:00100000:3.0:1788940885.149880:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940885.149888:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944972928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788940885.149917:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788940885.149959:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944972928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940885.149965:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788940885.150002:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940885.150064:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944972928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788940885.152475:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940885.152494:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944973056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788940885.152557:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940885.152717:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944973056 00000100:00100000:1.0:1788940885.152725:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944973056 00000100:00100000:1.0:1788940885.152777:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788940885.152786:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944973056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788940885.152840:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788940885.152886:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944973056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940885.152893:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788940885.153092:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944973056:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788940885.279146:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788940885.852729:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940886.876832:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788940887.195636:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940887.195643:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788940887.195647:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d03ed25000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940887.195680:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d03ed25000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940887.195708:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf07845f80 x1875839944973568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788940887.195742:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940887.195745:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788940887.195747:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d02e8ea000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940887.195752:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91d02e8ea000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940887.195761:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d020afb800 x1875839944974080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940887.195823:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944973440:0@lo:400:kworker.0 00000100:00100000:3.0:1788940887.195885:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940887.195931:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944974208:0@lo:400:kworker.0 00000100:00100000:3.0:1788940887.195956:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940887.195975:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944974720:0@lo:400:kworker.0 00000100:00100000:3.0:1788940887.196001:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940887.196027:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788940887.196034:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944973312:0@lo:400:kworker.0 00000100:00100000:3.0:1788940887.196057:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940887.196080:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944973952:0@lo:400:kworker.0 00000100:00100000:3.0:1788940887.196099:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940887.196115:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944974592:0@lo:400:kworker.0 00000100:00100000:3.0:1788940887.196134:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940887.196165:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944973312 00000100:00100000:3.0:1788940887.196173:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944973312 00000100:00100000:3.0:1788940887.196233:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788940887.196242:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944973312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940887.196321:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944973312:12345-0@lo:400:kworker.0 Request processed in 80us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940887.196327:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788940887.196350:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944973440 00000100:00100000:3.0:1788940887.196353:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944973440 00000100:00100000:3.0:1788940887.196397:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944973952 00000100:00100000:3.0:1788940887.196400:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944973952 00000100:00100000:3.0:1788940887.196418:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940887.196424:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944973440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940887.196456:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944973440:12345-0@lo:400:kworker.0 Request processed in 33us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940887.196462:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940887.196472:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940887.196477:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944973952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940887.196502:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944973952:12345-0@lo:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940887.196508:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788940887.196524:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940887.196554:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944973312:0@lo:400:kworker.0 00000100:00100000:3.0:1788940887.196567:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944973952:0@lo:400:kworker.0 00000100:00100000:3.0:1788940887.196576:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944973440:0@lo:400:kworker.0 00000100:00100000:2.0:1788940887.196847:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:303c4994-a6d4-4c7c-823f-eb7dad50725e:3648:1875839944973184:0@lo:400:kworker.0 00000100:00100000:2.0:1788940887.196885:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940887.196912:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944973824:0@lo:400:kworker.0 00000100:00100000:2.0:1788940887.196935:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940887.196952:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944974464:0@lo:400:kworker.0 00000100:00100000:2.0:1788940887.196972:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940887.196990:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788940887.196996:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944973696:0@lo:400:kworker.0 00000100:00100000:2.0:1788940887.197015:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940887.197025:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944974336:0@lo:400:kworker.0 00000100:00100000:2.0:1788940887.197041:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940887.197064:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944974208 00000100:00100000:2.0:1788940887.197067:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944974208 00000100:00100000:2.0:1788940887.197087:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944974720 00000100:00100000:2.0:1788940887.197090:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944974720 00000100:00100000:2.0:1788940887.197107:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944974592 00000100:00100000:2.0:1788940887.197109:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944974592 00000100:00100000:2.0:1788940887.197118:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944974464 00000100:00100000:2.0:1788940887.197120:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944974464 00000100:00100000:2.0:1788940887.197128:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944973696 00000100:00100000:2.0:1788940887.197130:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944973696 00000100:00100000:2.0:1788940887.197138:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944974336 00000100:00100000:2.0:1788940887.197139:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944974336 00000100:00100000:2.0:1788940887.197149:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788940887.197155:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944974208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940887.197187:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944974208:12345-0@lo:400:kworker.0 Request processed in 32us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940887.197204:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788940887.197216:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940887.197221:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944974720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940887.197245:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944974720:12345-0@lo:400:kworker.0 Request processed in 24us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940887.197250:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940887.197279:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788940887.197284:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944974592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940887.197306:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944974592:12345-0@lo:400:kworker.0 Request processed in 22us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940887.197310:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788940887.197319:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788940887.197323:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944974464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940887.197344:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839944974464:12345-0@lo:400:kworker.0 Request processed in 22us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940887.197349:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788940887.197357:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788940887.197362:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944973696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940887.197394:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944973696:12345-0@lo:400:kworker.0 Request processed in 32us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940887.197399:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788940887.197408:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788940887.197413:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944974336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940887.197434:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839944974336:12345-0@lo:400:kworker.0 Request processed in 21us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940887.197445:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788940887.197474:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944973184 00000100:00100000:2.0:1788940887.197477:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944973184 00000100:00100000:2.0:1788940887.197498:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788940887.197503:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3648:x1875839944973184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940887.197530:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3648:x1875839944973184:12345-0@lo:400:kworker.0 Request processed in 27us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940887.197535:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788940887.197557:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944973824 00000100:00100000:2.0:1788940887.197561:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944973824 00000100:00100000:2.0:1788940887.197582:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788940887.197588:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944973824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940887.197618:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944973824:12345-0@lo:400:kworker.0 Request processed in 29us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940887.197623:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788940887.197656:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07846680 x1875839944973696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940887.197667:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944973696:0@lo:400:kworker.0 00010000:00080000:2.0:1788940887.198222:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d020afb100 x1875839944974336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940887.198232:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839944974336:0@lo:400:kworker.0 00000100:00100000:2.0:1788940887.198240:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:303c4994-a6d4-4c7c-823f-eb7dad50725e:3648:1875839944973184:0@lo:400:kworker.0 00000100:00100000:2.0:1788940887.198249:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944973824:0@lo:400:kworker.0 00010000:00080000:2.0:1788940887.198284:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d020af9880 x1875839944974464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940887.198304:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839944974464:0@lo:400:kworker.0 00000100:00080000:2.0:1788940887.198336:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940887.198340:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788940887.198363:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d020af8e00 x1875839944974592/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940887.198371:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944974592:0@lo:400:kworker.0 00010000:00080000:2.0:1788940887.198395:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d020afbb80 x1875839944974208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940887.198403:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944974208:0@lo:400:kworker.0 00010000:00080000:2.0:1788940887.198416:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d020afaa00 x1875839944974720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940887.198423:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944974720:0@lo:400:kworker.0 00000100:00100000:1.0:1788940887.199921:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944973568:0@lo:8:kworker.0 00000100:00100000:1.0:1788940887.199994:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940887.200027:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944974080:0@lo:8:kworker.0 00000100:00100000:1.0:1788940887.200044:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940887.200083:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944973568 00000100:00100000:1.0:1788940887.200091:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944973568 00000100:00100000:1.0:1788940887.200120:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944974080 00000100:00100000:1.0:1788940887.200122:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944974080 00000100:00100000:1.0:1788940887.200134:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788940887.200140:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1875839944973568:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788940887.200172:0:18669:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 642 last 0 00000020:00000080:1.0:1788940887.200202:0:18669:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08bade678 00002000:00100000:1.0:1788940887.200216:0:18669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91cf06076800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788940887.200220:0:18669:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788940887.200222:0:18669:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788940887.200419:0:18669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788940887.200444:0:18669:0:(import.c:65:import_set_state_nolock()) ffff91cf06071000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940887.200488:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875839944973568:12345-0@lo:8:kworker.0 Request processed in 347us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940887.200495:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788940887.200511:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788940887.200515:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1875839944974080:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788940887.200539:0:18669:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 642 last 0 00000020:00000080:1.0:1788940887.200554:0:18669:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08bade67f 00002000:00100000:1.0:1788940887.200560:0:18669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff91cf06072800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788940887.200563:0:18669:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788940887.200565:0:18669:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788940887.200589:0:18669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788940887.200601:0:18669:0:(import.c:65:import_set_state_nolock()) ffff91cf06077000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940887.200630:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875839944974080:12345-0@lo:8:kworker.0 Request processed in 113us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940887.200636:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788940887.203218:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07845f80 x1875839944973568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788940912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788940887.203240:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788940887.203249:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788940887.203276:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788940887.203281:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03ed25000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788940887.203296:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788940887.203303:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944973568:0@lo:8:kworker.0 00010000:00080000:1.0:1788940887.203329:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d020afb800 x1875839944974080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788940912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788940887.203339:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788940887.203344:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788940887.203347:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788940887.203348:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02e8ea000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788940887.203365:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788940887.203392:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839944974080:0@lo:8:kworker.0 00000004:00080000:1.0:1788940887.203479:0:17177:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1788940887.203503:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17177:1875839944974976:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788940887.203559:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940887.203584:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0069673c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940887.203598:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944974848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940887.203623:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940887.203662:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944974848 00000100:00100000:1.0:1788940887.203668:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944974848 00000004:00080000:3.0:1788940887.203918:0:17176:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788940887.204012:0:17176:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642536754776ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788940887.204020:0:17176:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788940887.205088:0:17894:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788940887.205115:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1875839944975232:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788940887.205169:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940887.205199:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0207fb780 going to sleep for 11 seconds 00000004:00080000:0.0:1788940887.205215:0:17893:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788940887.205465:0:17893:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 642538206840ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788940887.205473:0:17893:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788940887.206080:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940887.206090:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875839944974848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940887.206118:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788940887.206172:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875839944974848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (2548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940887.206180:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788940887.206205:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940887.206222:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944974976 00000100:00100000:1.0:1788940887.206230:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944974976 00000100:00100000:1.0:1788940887.206253:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944975232 00000100:00100000:1.0:1788940887.206271:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944975232 00000100:00100000:1.0:1788940887.206298:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940887.206305:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17177:x1875839944974976:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788940887.206765:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788940887.206776:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17894:x1875839944975232:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788940887.208663:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944975104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940887.208741:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788940887.208928:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d020c8dc00 x1875839944974848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940887.208947:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944974848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940887.208971:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944975104 00000100:00100000:0.0:1788940887.208975:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944975104 00000100:00100000:0.0:1788940887.209009:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788940887.209015:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1875839944975104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788940887.209035:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788940887.209075:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1875839944975104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940887.209081:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788940887.209111:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08dd0a80 x1875839944975104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940887.209123:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944975104:0@lo:13:osp-pre-1-1.0 00002000:00080000:1.0:1788940887.210958:0:18669:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788940887.210972:0:18669:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788940887.210980:0:18669:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000004:00080000:3.0:1788940887.221389:0:17130:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788940887.221435:0:18668:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788940887.221443:0:18668:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788940887.221553:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17894:x1875839944975232:12345-0@lo:7:osp-pre-1-1.0 Request processed in 14773us (16377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940887.221567:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1788940887.221612:0:17882:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00080000:0.0:1788940887.221884:0:17894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08dd1c00 x1875839944975232/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788940903 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940887.221922:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1875839944975232:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788940887.222318:0:17894:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788940887.222362:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1875839944975360:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788940887.222417:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940887.222445:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0207fb780 going to sleep for 11 seconds 00000100:00100000:0.0:1788940887.222472:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944975360 00000100:00100000:0.0:1788940887.222479:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944975360 00000100:00100000:0.0:1788940887.222524:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788940887.222533:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17894:x1875839944975360:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788940887.222559:0:19149:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788940887.222593:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17894:x1875839944975360:12345-0@lo:5:osp-pre-1-1.0 Request processed in 60us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940887.222600:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788940887.222628:0:17894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08dd1c00 x1875839944975360/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940903 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940887.222638:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1875839944975360:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788940887.222647:0:17894:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788940887.222670:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1875839944975488:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788940887.222691:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940887.222704:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0207fb780 going to sleep for 11 seconds 00000100:00100000:0.0:1788940887.222713:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944975488 00000100:00100000:0.0:1788940887.222718:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944975488 00000100:00100000:0.0:1788940887.222735:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788940887.222741:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17894:x1875839944975488:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788940887.222776:0:19149:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000100:00080000:2.0:1788940887.223391:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1788940887.228059:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788940887.228070:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d97e705/0x9c34acc08bade686 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.228093:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=642s v=(0 0) 00010000:00010000:1.0:1788940887.228097:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940887.228104:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d97e705/0x9c34acc08bade686 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.228122:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d97e705/0x9c34acc08bade686 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.228132:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d97e705/0x9c34acc08bade686 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.228139:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d97e705/0x9c34acc08bade686 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.228157:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940887.228169:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940887.228175:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d97e705/0x9c34acc08bade686 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.228182:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042053000 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940887.228187:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d97e705/0x9c34acc08bade686 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.228195:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d97e705/0x9c34acc08bade686 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.228223:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d97e705/0x9c34acc08bade686 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.228230:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d97e705/0x9c34acc08bade686 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.229918:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940887.229925:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940887.229928:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940887.230995:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788940887.231006:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3f8043a/0x9c34acc08bade68d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.231022:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=642s v=(0 0) 00010000:00010000:1.0:1788940887.231026:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940887.231031:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3f8043a/0x9c34acc08bade68d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.231043:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3f8043a/0x9c34acc08bade68d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.231053:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3f8043a/0x9c34acc08bade68d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.231061:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3f8043a/0x9c34acc08bade68d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.231098:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788940887.231977:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788940887.231985:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9dae9a4/0x9c34acc08bade694 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.231996:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=642s v=(0 0) 00010000:00010000:1.0:1788940887.232000:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940887.232005:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9dae9a4/0x9c34acc08bade694 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.232015:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9dae9a4/0x9c34acc08bade694 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.232023:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9dae9a4/0x9c34acc08bade694 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.232031:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9dae9a4/0x9c34acc08bade694 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.232054:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788940887.232439:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788940887.232445:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade69b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.232452:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=642s v=(0 0) 00010000:00010000:1.0:1788940887.232461:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940887.232465:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade69b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.232475:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade69b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.232483:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade69b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.232489:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade69b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.232601:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788940887.233046:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788940887.233054:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f5cc880/0x9c34acc08bade6a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.233063:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=642s v=(0 0) 00010000:00010000:1.0:1788940887.233066:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940887.233071:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f5cc880/0x9c34acc08bade6a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.233080:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f5cc880/0x9c34acc08bade6a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.233088:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f5cc880/0x9c34acc08bade6a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.233101:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f5cc880/0x9c34acc08bade6a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233131:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788940887.233139:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3f8043a/0x9c34acc08bade68d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233147:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042052c00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940887.233151:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3f8043a/0x9c34acc08bade68d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233160:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3f8043a/0x9c34acc08bade68d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233180:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3f8043a/0x9c34acc08bade68d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233186:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3f8043a/0x9c34acc08bade68d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233206:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788940887.233215:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9dae9a4/0x9c34acc08bade694 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233221:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042053600 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940887.233224:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9dae9a4/0x9c34acc08bade694 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233231:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9dae9a4/0x9c34acc08bade694 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233241:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9dae9a4/0x9c34acc08bade694 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233247:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9dae9a4/0x9c34acc08bade694 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233283:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940887.233286:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade69b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233293:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042053c00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940887.233296:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade69b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233303:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade69b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233323:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade69b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233329:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade69b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233340:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940887.233343:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f5cc880/0x9c34acc08bade6a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233348:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042053400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940887.233351:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f5cc880/0x9c34acc08bade6a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233359:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f5cc880/0x9c34acc08bade6a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233368:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f5cc880/0x9c34acc08bade6a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.233388:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940887.233390:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940887.233392:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940887.233514:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940887.236747:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940887.240801:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788940887.240814:0:18669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f5cc880/0x9c34acc08bade6a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940887.241425:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788940887.241433:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa93aac0/0x9c34acc08bade6a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.241447:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=642s v=(0 0) 00010000:00010000:1.0:1788940887.241451:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940887.241457:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa93aac0/0x9c34acc08bade6a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.241470:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa93aac0/0x9c34acc08bade6a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.241478:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa93aac0/0x9c34acc08bade6a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.241485:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa93aac0/0x9c34acc08bade6a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.244123:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940887.244136:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa93aac0/0x9c34acc08bade6a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.244149:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042053a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940887.244154:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa93aac0/0x9c34acc08bade6a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.244165:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa93aac0/0x9c34acc08bade6a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.244195:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa93aac0/0x9c34acc08bade6a9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.244360:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940887.244363:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940887.244365:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940887.244460:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788940887.244468:0:18669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa93aac0/0x9c34acc08bade6a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.244680:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940887.245000:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788940887.245008:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061758466/0x9c34acc08bade6b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.245022:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=642s v=(0 0) 00010000:00010000:1.0:1788940887.245027:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940887.245033:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061758466/0x9c34acc08bade6b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.245047:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061758466/0x9c34acc08bade6b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.245056:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061758466/0x9c34acc08bade6b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.245064:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061758466/0x9c34acc08bade6b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.245089:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940887.245208:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940887.245214:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061758466/0x9c34acc08bade6b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.245222:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042052000 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940887.245225:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061758466/0x9c34acc08bade6b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.245233:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061758466/0x9c34acc08bade6b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.245276:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061758466/0x9c34acc08bade6b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.245284:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061758466/0x9c34acc08bade6b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.245300:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940887.245301:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940887.245303:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940887.253296:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788940887.253311:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade6b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.253336:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=642s v=(0 0) 00010000:00010000:1.0:1788940887.253341:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940887.253348:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade6b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.253363:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade6b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.253384:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade6b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.253393:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade6b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.253413:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940887.253426:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940887.253432:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade6b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.253440:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042053c00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940887.253445:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade6b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.253456:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade6b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.253484:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade6b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.253491:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe5b8bc8/0x9c34acc08bade6b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.253511:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940887.253513:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940887.253514:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940887.257020:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940887.257033:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003536aeb4/0x9c34acc08bade6be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.257051:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788940887.257056:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940887.257061:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003536aeb4/0x9c34acc08bade6be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.257082:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003536aeb4/0x9c34acc08bade6be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.257093:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003536aeb4/0x9c34acc08bade6be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.257100:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003536aeb4/0x9c34acc08bade6be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.257117:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940887.257128:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940887.257133:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003536aeb4/0x9c34acc08bade6be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.257140:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940887.257144:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003536aeb4/0x9c34acc08bade6be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.257153:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003536aeb4/0x9c34acc08bade6be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.257168:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003536aeb4/0x9c34acc08bade6be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.257176:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003536aeb4/0x9c34acc08bade6be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.257197:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940887.257198:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940887.257200:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940887.258576:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940887.258587:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08bade6c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.258602:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788940887.258606:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940887.258612:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08bade6c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.258623:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08bade6c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.258632:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08bade6c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.258639:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08bade6c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.258660:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940887.259358:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940887.259368:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08bade6c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.259388:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219e00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940887.259393:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08bade6c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.259401:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08bade6c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.259421:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08bade6c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.259428:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08bade6c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.259448:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940887.259451:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940887.259452:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940887.260023:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940887.260031:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000777eeade/0x9c34acc08bade6cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.260052:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788940887.260055:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940887.260060:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000777eeade/0x9c34acc08bade6cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.260071:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000777eeade/0x9c34acc08bade6cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.260079:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000777eeade/0x9c34acc08bade6cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.260087:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000777eeade/0x9c34acc08bade6cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.260112:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940887.260500:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940887.260507:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000777eeade/0x9c34acc08bade6cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.260515:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940887.260518:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000777eeade/0x9c34acc08bade6cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.260527:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000777eeade/0x9c34acc08bade6cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.260541:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000777eeade/0x9c34acc08bade6cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.260548:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000777eeade/0x9c34acc08bade6cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.260578:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940887.260580:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940887.260581:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940887.261174:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940887.261183:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000521df18e/0x9c34acc08bade6d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.261195:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788940887.261199:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940887.261204:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000521df18e/0x9c34acc08bade6d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.261214:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000521df18e/0x9c34acc08bade6d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.261233:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000521df18e/0x9c34acc08bade6d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.261253:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000521df18e/0x9c34acc08bade6d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.261297:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940887.261907:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940887.261915:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000521df18e/0x9c34acc08bade6d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.261924:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940887.261928:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000521df18e/0x9c34acc08bade6d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.261947:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000521df18e/0x9c34acc08bade6d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.261962:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000521df18e/0x9c34acc08bade6d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.261970:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000521df18e/0x9c34acc08bade6d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.261988:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940887.261990:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940887.261991:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788940887.274146:0:19484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788940887.274183:0:19484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788940887.274196:0:19484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788940887.274561:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17894:x1875839944975488:12345-0@lo:5:osp-pre-1-1.0 Request processed in 51815us (51864us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788940887.274573:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788940887.276186:0:17894:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788940887.276202:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17894:1875839944975488:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788940887.276219:0:17894:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788940887.276360:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17894:1875839944975616:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788940887.276441:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940887.276473:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0207fb780 going to sleep for 11 seconds 00002000:00010000:2.0:1788940887.277024:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788940887.277034:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026d8bc11/0x9c34acc08bade6da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.277054:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=642s v=(0 0) 00010000:00010000:2.0:1788940887.277059:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940887.277066:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026d8bc11/0x9c34acc08bade6da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.277079:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026d8bc11/0x9c34acc08bade6da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.277090:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026d8bc11/0x9c34acc08bade6da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.277097:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026d8bc11/0x9c34acc08bade6da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.277116:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788940887.277654:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944975616 00000100:00100000:3.0:1788940887.277663:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944975616 00000100:00100000:3.0:1788940887.277713:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940887.277723:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17894:x1875839944975616:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788940887.277870:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17894:x1875839944975616:12345-0@lo:900:osp-pre-1-1.0 Request processed in 147us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940887.277879:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788940887.278945:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940887.278958:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026d8bc11/0x9c34acc08bade6da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.278970:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7600 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940887.278975:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026d8bc11/0x9c34acc08bade6da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.278986:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026d8bc11/0x9c34acc08bade6da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.279010:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026d8bc11/0x9c34acc08bade6da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.279016:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026d8bc11/0x9c34acc08bade6da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.279036:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940887.279038:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940887.279040:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788940887.279082:0:17894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08dd1c00 x1875839944975616/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788940903 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940887.279096:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17894:1875839944975616:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1788940887.280204:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940887.280217:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034449836/0x9c34acc08bade6e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.280233:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788940887.280238:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940887.280245:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034449836/0x9c34acc08bade6e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.280284:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034449836/0x9c34acc08bade6e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.280308:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034449836/0x9c34acc08bade6e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.280315:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034449836/0x9c34acc08bade6e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.280336:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788940887.280772:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940887.280779:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cee6f667/0x9c34acc08bade6e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.280787:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788940887.280790:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940887.280871:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cee6f667/0x9c34acc08bade6e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.280882:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cee6f667/0x9c34acc08bade6e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.280890:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cee6f667/0x9c34acc08bade6e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.280897:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cee6f667/0x9c34acc08bade6e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.280920:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788940887.281230:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940887.281236:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078d72a3f/0x9c34acc08bade6ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.281244:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788940887.281247:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940887.281252:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078d72a3f/0x9c34acc08bade6ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.281283:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078d72a3f/0x9c34acc08bade6ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.281291:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078d72a3f/0x9c34acc08bade6ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.281298:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078d72a3f/0x9c34acc08bade6ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.281318:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788940887.281572:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788940887.281580:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034449836/0x9c34acc08bade6e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.281600:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940887.281604:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034449836/0x9c34acc08bade6e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.281612:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034449836/0x9c34acc08bade6e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.281628:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034449836/0x9c34acc08bade6e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.281635:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034449836/0x9c34acc08bade6e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.281653:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940887.281657:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cee6f667/0x9c34acc08bade6e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.281663:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940887.281666:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cee6f667/0x9c34acc08bade6e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.281673:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cee6f667/0x9c34acc08bade6e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.281681:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cee6f667/0x9c34acc08bade6e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.281695:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cee6f667/0x9c34acc08bade6e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.281708:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940887.281711:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078d72a3f/0x9c34acc08bade6ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.281717:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218000 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940887.281721:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078d72a3f/0x9c34acc08bade6ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.281729:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078d72a3f/0x9c34acc08bade6ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.281739:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078d72a3f/0x9c34acc08bade6ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.281746:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078d72a3f/0x9c34acc08bade6ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.281758:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940887.281759:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940887.281761:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940887.281768:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940887.283080:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940887.283092:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08bade6f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.283107:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788940887.283118:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940887.283124:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08bade6f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.283137:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08bade6f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.283147:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08bade6f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.283155:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08bade6f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.283177:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940887.283764:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940887.283772:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08bade6f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.283788:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940887.283802:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08bade6f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.283812:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08bade6f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.283828:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08bade6f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.283834:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08bade6f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.283854:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940887.283855:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940887.283857:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940887.283982:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940887.284993:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940887.285003:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fc2a010/0x9c34acc08bade6fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.285017:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788940887.285020:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940887.285026:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fc2a010/0x9c34acc08bade6fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.285038:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fc2a010/0x9c34acc08bade6fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.285047:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fc2a010/0x9c34acc08bade6fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.285061:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fc2a010/0x9c34acc08bade6fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.285079:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940887.285481:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940887.285487:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fc2a010/0x9c34acc08bade6fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.285496:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937000 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940887.285500:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fc2a010/0x9c34acc08bade6fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.285509:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fc2a010/0x9c34acc08bade6fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.285531:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fc2a010/0x9c34acc08bade6fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.285540:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fc2a010/0x9c34acc08bade6fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.285557:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940887.285559:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940887.285560:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940887.285921:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788940887.285928:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000531190cd/0x9c34acc08bade704 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.285950:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=642s v=(0 0) 00010000:00010000:2.0:1788940887.285954:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940887.285958:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000531190cd/0x9c34acc08bade704 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.285969:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000531190cd/0x9c34acc08bade704 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.285977:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000531190cd/0x9c34acc08bade704 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.285985:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000531190cd/0x9c34acc08bade704 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.286016:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940887.286906:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940887.286915:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000531190cd/0x9c34acc08bade704 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.286925:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940887.286929:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000531190cd/0x9c34acc08bade704 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.287003:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000531190cd/0x9c34acc08bade704 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.287019:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000531190cd/0x9c34acc08bade704 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.287026:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000531190cd/0x9c34acc08bade704 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.287046:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940887.287048:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940887.287050:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940887.287441:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788940887.287449:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e629a21b/0x9c34acc08bade70b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.287460:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=642s v=(0 0) 00010000:00010000:2.0:1788940887.287464:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940887.287469:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e629a21b/0x9c34acc08bade70b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.287478:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e629a21b/0x9c34acc08bade70b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.287487:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e629a21b/0x9c34acc08bade70b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.287493:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e629a21b/0x9c34acc08bade70b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.287519:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940887.290547:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788940887.290561:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bfbb431/0x9c34acc08bade712 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.290578:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=642s v=(0 0) 00010000:00010000:2.0:1788940887.290589:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940887.290595:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bfbb431/0x9c34acc08bade712 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.290610:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bfbb431/0x9c34acc08bade712 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.290621:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bfbb431/0x9c34acc08bade712 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.290629:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bfbb431/0x9c34acc08bade712 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.290651:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788940887.290847:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940887.290855:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e629a21b/0x9c34acc08bade70b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.290864:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940887.290869:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e629a21b/0x9c34acc08bade70b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.290879:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e629a21b/0x9c34acc08bade70b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.290899:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e629a21b/0x9c34acc08bade70b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.290918:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e629a21b/0x9c34acc08bade70b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.290934:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940887.290938:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bfbb431/0x9c34acc08bade712 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.290944:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940887.290947:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bfbb431/0x9c34acc08bade712 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.290955:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bfbb431/0x9c34acc08bade712 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.290966:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bfbb431/0x9c34acc08bade712 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.290973:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bfbb431/0x9c34acc08bade712 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.290983:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940887.290985:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940887.290986:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940887.291317:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940887.291985:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788940887.291995:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08bade719 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.292015:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=642s v=(0 0) 00010000:00010000:2.0:1788940887.292018:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940887.292023:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08bade719 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.292034:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08bade719 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.292042:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08bade719 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.292049:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08bade719 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.293015:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940887.293591:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788940887.293600:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08bade720 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.293615:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=642s v=(0 0) 00010000:00010000:2.0:1788940887.293619:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940887.293625:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08bade720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.293638:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08bade720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.293659:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08bade720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.293666:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08bade720 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.298487:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940887.298506:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08bade719 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.298521:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f7800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940887.298526:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08bade719 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.298538:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08bade719 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.298559:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08bade719 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.298567:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08bade719 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.298588:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940887.298592:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08bade720 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.298598:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f7e00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940887.298601:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08bade720 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.298607:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08bade720 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.298631:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08bade720 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.298639:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940887.298641:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940887.298643:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940887.298718:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788940887.298726:0:18669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08bade720 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.298869:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940887.300013:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788940887.300025:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08bade727 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.300039:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=642s v=(0 0) 00010000:00010000:2.0:1788940887.300044:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940887.300051:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08bade727 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.300064:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08bade727 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.300074:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08bade727 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.300094:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08bade727 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.300120:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940887.300489:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940887.300497:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08bade727 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.300506:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940887.300510:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08bade727 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.300519:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08bade727 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.300535:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08bade727 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.300543:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08bade727 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.300558:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940887.300560:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940887.300567:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940887.302418:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940887.302429:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08bade72e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.302445:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788940887.302449:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940887.302455:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08bade72e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.302471:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08bade72e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.302480:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08bade72e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.302487:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08bade72e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.303768:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788940887.308422:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940887.308436:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001adf0f7e/0x9c34acc08bade735 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.308454:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788940887.308458:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940887.308464:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001adf0f7e/0x9c34acc08bade735 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.308493:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001adf0f7e/0x9c34acc08bade735 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.308504:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001adf0f7e/0x9c34acc08bade735 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.308512:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001adf0f7e/0x9c34acc08bade735 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.310843:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940887.310858:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08bade72e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.310872:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936c00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940887.310878:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08bade72e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.310889:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08bade72e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.310913:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08bade72e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.310921:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08bade72e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.310957:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940887.310961:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001adf0f7e/0x9c34acc08bade735 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.310967:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788940887.310985:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001adf0f7e/0x9c34acc08bade735 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.310996:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001adf0f7e/0x9c34acc08bade735 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.311012:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001adf0f7e/0x9c34acc08bade735 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.311020:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940887.311021:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940887.311023:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940887.311964:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788940887.311974:0:18669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001adf0f7e/0x9c34acc08bade735 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.312485:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940887.312648:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940887.312656:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002805bad/0x9c34acc08bade73c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.312669:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788940887.312674:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940887.312680:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002805bad/0x9c34acc08bade73c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.312765:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002805bad/0x9c34acc08bade73c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.312789:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002805bad/0x9c34acc08bade73c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.312864:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002805bad/0x9c34acc08bade73c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.312886:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940887.313000:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940887.313006:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002805bad/0x9c34acc08bade73c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.313014:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937e00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940887.313019:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002805bad/0x9c34acc08bade73c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.313027:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002805bad/0x9c34acc08bade73c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.313042:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002805bad/0x9c34acc08bade73c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.313049:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002805bad/0x9c34acc08bade73c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.313063:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940887.313065:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940887.313066:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940887.313583:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788940887.313591:0:18669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068538022/0x9c34acc08bade743 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.313602:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788940887.313606:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940887.313611:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068538022/0x9c34acc08bade743 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.313622:0:18669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068538022/0x9c34acc08bade743 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.313631:0:18669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068538022/0x9c34acc08bade743 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.313639:0:18669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068538022/0x9c34acc08bade743 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.315302:0:18669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788940887.315413:0:18669:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1788940887.315531:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17177:x1875839944974976:12345-0@lo:5:osp-pre-1-0.0 Request processed in 109220us (111966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940887.315542:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940887.317870:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17177:1875839944974976:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788940887.317894:0:17177:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1788940887.318072:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17177:1875839944975744:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788940887.318131:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940887.318159:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06e90b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940887.319674:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944975744 00000100:00100000:3.0:1788940887.319754:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944975744 00000100:00100000:3.0:1788940887.320026:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788940887.320037:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17177:x1875839944975744:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788940887.320085:0:18668:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:0.0:1788940887.321139:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940887.321150:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068538022/0x9c34acc08bade743 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.321162:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940887.321166:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068538022/0x9c34acc08bade743 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.321189:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068538022/0x9c34acc08bade743 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.321209:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068538022/0x9c34acc08bade743 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940887.321216:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068538022/0x9c34acc08bade743 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.321896:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940887.321900:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940887.321902:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940887.330494:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17177:x1875839944975744:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10452us (12356us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788940887.330508:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788940887.330656:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17177:1875839944975744:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788940887.330671:0:17177:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:0.0:1788940887.904554:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940888.221033:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940888.221057:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944975872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940888.221129:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940888.221182:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944975872 00000100:00100000:0.0:1788940888.221190:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944975872 00000100:00100000:0.0:1788940888.221241:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788940888.221251:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944975872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940888.221301:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788940888.221347:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944975872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940888.221354:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788940888.221416:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944975872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788940888.923391:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788940889.485588:0:19839:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788940889.947555:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940890.267477:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944976000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940890.267554:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940890.267642:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944976128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940890.267686:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940890.267745:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944976128 00000100:00100000:1.0:1788940890.267764:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944976128 00000100:00100000:2.0:1788940890.269926:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944976256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788940890.270289:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944976000 00000100:00100000:2.0:1788940890.270298:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944976000 00000100:00100000:2.0:1788940890.270366:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788940890.270376:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944976000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940890.270412:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788940890.270462:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944976000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (2908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940890.270469:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788940890.270500:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940890.270566:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944976000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940890.270648:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944976256 00000100:00100000:3.0:1788940890.270653:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944976256 00000100:00100000:3.0:1788940890.270832:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788940890.270839:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944976256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788940890.270857:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788940890.270889:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944976256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940890.270895:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788940890.271157:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940890.271186:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944976256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940890.272570:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940890.272589:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944976128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788940890.272625:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788940890.272720:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944976128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (5033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940890.272727:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788940890.276305:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944976128:0@lo:13:osp-pre-0-1.0 00000020:00000004:1.0:1788940890.557701:0:19891:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788940890.557998:0:19891:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788940890.972385:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788940891.101127:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788940891.804142:0:19941:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788940891.804471:0:19941:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788940891.996645:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940892.082296:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940892.084529:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921805568 00000100:00100000:2.0:1788940892.084551:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921805568 00000100:00100000:2.0:1788940892.084608:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 115 00000100:00100000:2.0:1788940892.084618:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2403:x1875839921805568:12345-192.168.202.25@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788940892.084666:0:17143:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c999e41f-3797-4c65-8d35-6b866b5f4f29@192.168.202.25@tcp t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:2.0:1788940892.084711:0:17143:0:(genops.c:1393:class_connect()) connect: client c999e41f-3797-4c65-8d35-6b866b5f4f29, cookie 0x9c34acc08bade74a 00000100:00080000:2.0:1788940892.084901:0:17143:0:(import.c:65:import_set_state_nolock()) ffff91cf07e0c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940892.085121:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+5:2403:x1875839921805568:12345-192.168.202.25@tcp:250:mount.lustre.0 Request processed in 502us (2839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940892.085130:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 115 00000100:00100000:2.0:1788940892.098322:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940892.098381:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921805696 00000100:00100000:2.0:1788940892.098395:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921805696 00000100:00100000:2.0:1788940892.098465:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 116 00000100:00100000:2.0:1788940892.098478:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+5:14964:x1875839921805696:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788940892.098503:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940892.098528:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0027f6200/0x9c34acc08bade751 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7611 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.098571:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0027f6200/0x9c34acc08bade751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7611 expref: 6 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.098584:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0027f6200/0x9c34acc08bade751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7611 expref: 6 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.098595:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f6200, rc 0) 00000100:00100000:2.0:1788940892.098675:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+6:14964:x1875839921805696:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 199us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940892.098683:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 116 00000100:00100000:3.0:1788940892.109086:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940892.109146:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921805824 00000100:00100000:3.0:1788940892.109160:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921805824 00000100:00100000:3.0:1788940892.109242:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 117 00000100:00100000:3.0:1788940892.109295:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+6:14964:x1875839921805824:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788940892.109469:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+6:14964:x1875839921805824:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 216us (537us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788940892.109479:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 117 00000100:00100000:0.0:1788940892.117357:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940892.117871:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921805952 00000100:00100000:2.0:1788940892.117900:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921805952 00000100:00100000:2.0:1788940892.119574:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 118 00000100:00100000:2.0:1788940892.119604:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+6:14964:x1875839921805952:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788940892.119645:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940892.120765:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0027f6400/0x9c34acc08bade758 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7618 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.120817:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0027f6400/0x9c34acc08bade758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7618 expref: 7 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.120833:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0027f6400/0x9c34acc08bade758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7618 expref: 7 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.120846:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f6400, rc 0) 00000100:00100000:2.0:1788940892.122131:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+7:14964:x1875839921805952:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 2525us (4787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940892.122146:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 118 00000100:00100000:3.0:1788940892.136638:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940892.136898:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921806080 00000100:00100000:3.0:1788940892.136912:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921806080 00000100:00100000:3.0:1788940892.137000:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 119 00000100:00100000:3.0:1788940892.137016:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+7:14964:x1875839921806080:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788940892.140537:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+8:14964:x1875839921806080:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 3506us (3899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940892.140557:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 119 00000100:00100000:0.0:1788940892.145364:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940892.145560:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921806208 00000100:00100000:3.0:1788940892.145575:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921806208 00000100:00100000:3.0:1788940892.145657:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 120 00000100:00100000:3.0:1788940892.145671:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+8:14964:x1875839921806208:12345-192.168.202.25@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788940892.145894:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+8:14964:x1875839921806208:12345-192.168.202.25@tcp:503:mount.lustre.0 Request processed in 225us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940892.145903:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 120 00000100:00100000:0.0:1788940892.159126:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940892.159714:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921806336 00000100:00100000:3.0:1788940892.159730:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921806336 00000100:00100000:3.0:1788940892.159821:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 121 00000100:00100000:3.0:1788940892.159834:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+8:14982:x1875839921806336:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788940892.160644:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+8:14982:x1875839921806336:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 806us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940892.160656:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 121 00000100:00100000:0.0:1788940892.188907:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940892.189028:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921806464 00000100:00100000:3.0:1788940892.189045:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921806464 00000100:00100000:3.0:1788940892.189130:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 122 00000100:00100000:3.0:1788940892.189142:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+8:14982:x1875839921806464:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788940892.189366:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+8:14982:x1875839921806464:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 226us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940892.189376:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 122 00000100:00100000:0.0:1788940892.196800:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940892.200387:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921806592 00000100:00100000:3.0:1788940892.200405:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921806592 00000100:00100000:0.0:1788940892.200712:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 123 00000100:00100000:0.0:1788940892.200726:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+8:14982:x1875839921806592:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940892.201132:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+8:14982:x1875839921806592:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 407us (4709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.201141:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 123 00000100:00100000:3.0:1788940892.206110:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940892.206231:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921806720 00000100:00100000:2.0:1788940892.206242:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921806720 00000100:00100000:2.0:1788940892.206340:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 124 00000100:00100000:2.0:1788940892.206353:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+8:14964:x1875839921806720:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788940892.206375:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940892.206399:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0027f6000/0x9c34acc08bade75f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7649 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.206441:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0027f6000/0x9c34acc08bade75f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7649 expref: 9 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.206455:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0027f6000/0x9c34acc08bade75f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7649 expref: 9 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.206484:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f6000, rc 0) 00000100:00100000:2.0:1788940892.206548:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+9:14964:x1875839921806720:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 198us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940892.206556:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 124 00000100:00100000:2.0:1788940892.211708:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940892.211865:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921806848 00000100:00100000:1.0:1788940892.211876:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921806848 00000100:00100000:1.0:1788940892.211998:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 125 00000100:00100000:1.0:1788940892.212007:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+9:14964:x1875839921806848:12345-192.168.202.25@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788940892.212031:0:17143:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788940892.212060:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788940892.212063:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788940892.212066:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788940892.212067:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788940892.212069:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788940892.217554:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+9:14964:x1875839921806848:12345-192.168.202.25@tcp:256:mount.lustre.0 Request processed in 5536us (5844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940892.217571:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 125 00000100:00100000:2.0:1788940892.220754:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940892.221135:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921806976 00000100:00100000:0.0:1788940892.221147:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921806976 00000100:00100000:0.0:1788940892.221206:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 126 00000100:00100000:0.0:1788940892.221216:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+9:14964:x1875839921806976:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788940892.221234:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940892.221252:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584dc00/0x9c34acc08bade766 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7650 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.221307:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584dc00/0x9c34acc08bade766 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7650 expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.221319:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584dc00/0x9c34acc08bade766 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7650 expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.221351:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584dc00, rc 0) 00000100:00100000:0.0:1788940892.221413:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+10:14964:x1875839921806976:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 198us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.221421:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 126 00000100:00100000:2.0:1788940892.228084:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940892.228945:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921807104 00000100:00100000:1.0:1788940892.228957:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921807104 00000100:00100000:1.0:1788940892.229020:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 127 00000100:00100000:1.0:1788940892.229028:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+10:14964:x1875839921807104:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788940892.229429:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+10:14964:x1875839921807104:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 397us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940892.229457:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 127 00000100:00100000:3.0:1788940892.232771:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940892.232858:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921807232 00000100:00100000:0.0:1788940892.232869:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921807232 00000100:00100000:0.0:1788940892.232946:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 128 00000100:00100000:0.0:1788940892.232957:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+10:14964:x1875839921807232:12345-192.168.202.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788940892.233122:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+10:14964:x1875839921807232:12345-192.168.202.25@tcp:503:mount.lustre.0 Request processed in 167us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.233130:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 128 00000100:00100000:2.0:1788940892.244191:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940892.244286:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921807360 00000100:00100000:3.0:1788940892.244298:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921807360 00000100:00100000:3.0:1788940892.244367:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 129 00000100:00100000:3.0:1788940892.244380:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+10:14987:x1875839921807360:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788940892.244565:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+10:14987:x1875839921807360:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 187us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940892.244573:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 129 00000100:00100000:2.0:1788940892.255732:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940892.262376:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921807488 00000100:00100000:1.0:1788940892.262393:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921807488 00000100:00100000:1.0:1788940892.263200:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 130 00000100:00100000:1.0:1788940892.263216:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+10:14987:x1875839921807488:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788940892.263448:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+10:14987:x1875839921807488:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 235us (7732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940892.263457:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 130 00000100:00100000:3.0:1788940892.284310:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940892.284708:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921807616 00000100:00100000:2.0:1788940892.284720:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921807616 00000100:00100000:2.0:1788940892.284764:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:2.0:1788940892.284772:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875839921807616:12345-192.168.202.25@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788940892.284802:0:17152:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c6124d7c-7da2-46c0-b57e-23d795ef33aa@192.168.202.25@tcp t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:2.0:1788940892.284866:0:17152:0:(genops.c:1393:class_connect()) connect: client c6124d7c-7da2-46c0-b57e-23d795ef33aa, cookie 0x9c34acc08bade76d 00000004:00100000:2.0:1788940892.284901:0:17152:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1788940892.285118:0:17152:0:(import.c:65:import_set_state_nolock()) ffff91cf07e0e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940892.285216:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:2403:x1875839921807616:12345-192.168.202.25@tcp:38:mount.lustre.0 Request processed in 442us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940892.285225:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:3.0:1788940892.285722:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940892.285936:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921807872 00000100:00100000:0.0:1788940892.285944:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921807872 00000100:00100000:0.0:1788940892.285983:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:0.0:1788940892.285990:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875839921807872:12345-192.168.202.25@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788940892.286011:0:18958:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from c6124d7c-7da2-46c0-b57e-23d795ef33aa@192.168.202.25@tcp t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:0.0:1788940892.286049:0:18958:0:(genops.c:1393:class_connect()) connect: client c6124d7c-7da2-46c0-b57e-23d795ef33aa, cookie 0x9c34acc08bade774 00000004:00100000:0.0:1788940892.286066:0:18958:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1788940892.286249:0:18958:0:(import.c:65:import_set_state_nolock()) ffff91d017cd1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940892.286316:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:2403:x1875839921807872:12345-192.168.202.25@tcp:38:mount.lustre.0 Request processed in 325us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.286324:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:2.0:1788940892.308082:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940892.308125:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940892.308156:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940892.308249:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921808128 00000100:00100000:0.0:1788940892.308290:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921808128 00000100:00100000:0.0:1788940892.308374:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921808000 00000100:00100000:0.0:1788940892.308378:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921808000 00000100:00100000:0.0:1788940892.308393:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921807744 00000100:00100000:0.0:1788940892.308396:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921807744 00000100:00100000:0.0:1788940892.308409:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:0.0:1788940892.308419:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+7:14964:x1875839921808128:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788940892.308471:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788940892.308563:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+7:14964:x1875839921808128:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 144us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.308571:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:0.0:1788940892.308591:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:0.0:1788940892.308598:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:0:x1875839921808000:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788940892.308616:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788940892.308668:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:0:x1875839921808000:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 69us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.308674:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:0.0:1788940892.308686:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00100000:0.0:1788940892.308692:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:0:x1875839921807744:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788940892.308703:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788940892.308724:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:0:x1875839921807744:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 32us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.308730:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00080000:2.0:1788940892.308978:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940892.308982:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940892.315529:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940892.315694:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921808256 00000100:00100000:1.0:1788940892.315704:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921808256 00000100:00100000:1.0:1788940892.315766:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:1.0:1788940892.315777:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:14964:x1875839921808256:12345-192.168.202.25@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788940892.315870:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:14964:x1875839921808256:12345-192.168.202.25@tcp:40:mount.lustre.0 Request processed in 94us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940892.315877:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:0.0:1788940892.316743:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944976640:0@lo:400:kworker.0 00000100:00100000:0.0:1788940892.316792:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940892.316843:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944977152:0@lo:400:kworker.0 00000100:00100000:0.0:1788940892.316880:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.317014:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944976384:0@lo:400:kworker.0 00000100:00100000:3.0:1788940892.317080:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944976640 00000100:00100000:3.0:1788940892.317087:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944976640 00000100:00100000:3.0:1788940892.317140:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944977152 00000100:00100000:3.0:1788940892.317152:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944977152 00000100:00100000:3.0:1788940892.317192:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940892.317202:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944976640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940892.317288:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944977664:0@lo:400:kworker.0 00000100:00100000:2.0:1788940892.325759:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.325816:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944976896:0@lo:400:kworker.0 00000100:00100000:2.0:1788940892.325852:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.325874:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944977408:0@lo:400:kworker.0 00000100:00100000:3.0:1788940892.326562:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944976640:12345-0@lo:400:kworker.0 Request processed in 9358us (9764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940892.326575:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940892.326610:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940892.326622:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944977152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940892.326682:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944977152:12345-0@lo:400:kworker.0 Request processed in 65us (9801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940892.326689:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940892.326755:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944976768:0@lo:400:kworker.0 00000100:00100000:3.0:1788940892.326785:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940892.326804:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944977280:0@lo:400:kworker.0 00000100:00100000:3.0:1788940892.326827:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940892.326843:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839944977792:0@lo:400:kworker.0 00000100:00100000:3.0:1788940892.326862:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940892.327238:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940892.327250:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944978176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940892.327305:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940892.327349:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944976512:0@lo:400:kworker.0 00000100:00100000:3.0:1788940892.327376:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940892.327396:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944977024:0@lo:400:kworker.0 00000100:00100000:3.0:1788940892.327416:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.328572:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.328620:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944977920:0@lo:400:kworker.0 00000100:00100000:2.0:1788940892.328659:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.328713:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944976768 00000100:00100000:2.0:1788940892.328723:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944976768 00000100:00100000:2.0:1788940892.328769:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944977280 00000100:00100000:2.0:1788940892.328772:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944977280 00000100:00100000:2.0:1788940892.328792:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788940892.328801:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875839944976768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940892.328859:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875839944976768:12345-0@lo:400:kworker.0 Request processed in 58us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940892.328866:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788940892.329016:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788940892.329027:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944977280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940892.329062:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944977280:12345-0@lo:400:kworker.0 Request processed in 39us (2234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940892.329069:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788940892.329094:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944976512 00000100:00100000:2.0:1788940892.329098:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944976512 00000100:00100000:2.0:1788940892.329125:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944977024 00000100:00100000:2.0:1788940892.329129:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944977024 00000100:00100000:2.0:1788940892.329240:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788940892.329249:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944976512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940892.329356:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944976512:12345-0@lo:400:kworker.0 Request processed in 76us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940892.329364:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788940892.329378:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788940892.329384:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944977024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940892.329414:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944977024:12345-0@lo:400:kworker.0 Request processed in 30us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940892.329420:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788940892.329560:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944977024:0@lo:400:kworker.0 00000100:00100000:3.0:1788940892.329575:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d018b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944977536:0@lo:400:kworker.0 00000100:00100000:3.0:1788940892.329606:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940892.329620:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944978048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940892.329640:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940892.329679:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944976512:0@lo:400:kworker.0 00000100:00100000:3.0:1788940892.329708:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944978176 00000100:00100000:3.0:1788940892.329712:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944978176 00000100:00100000:3.0:1788940892.329733:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944978048 00000100:00100000:3.0:1788940892.329736:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944978048 00000100:00100000:3.0:1788940892.329747:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788940892.329753:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875839944978176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940892.329777:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788940892.329808:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875839944978176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (2503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940892.329814:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788940892.329827:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788940892.329833:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944978048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788940892.329843:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788940892.329871:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944978048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940892.329877:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940892.330060:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944976384 00000100:00100000:0.0:1788940892.330066:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944976384 00000100:00100000:0.0:1788940892.330097:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788940892.330104:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3645:x1875839944976384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940892.330144:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3645:x1875839944976384:12345-0@lo:400:kworker.0 Request processed in 41us (4395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.330150:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788940892.330309:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940892.330356:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944976640:0@lo:400:kworker.0 00000100:00100000:0.0:1788940892.330369:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944977152:0@lo:400:kworker.0 00000100:00100000:0.0:1788940892.330414:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944976896 00000100:00100000:0.0:1788940892.330417:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944976896 00000100:00100000:0.0:1788940892.330448:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944977792 00000100:00100000:0.0:1788940892.330451:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944977792 00000100:00100000:0.0:1788940892.330465:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944977408 00000100:00100000:0.0:1788940892.330467:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944977408 00000100:00100000:0.0:1788940892.330475:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944977920 00000100:00100000:0.0:1788940892.330477:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944977920 00000100:00100000:0.0:1788940892.330489:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944977536 00000100:00100000:0.0:1788940892.330491:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944977536 00000100:00100000:0.0:1788940892.330501:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944977664 00000100:00100000:0.0:1788940892.330504:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944977664 00000100:00100000:0.0:1788940892.330515:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788940892.330520:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944976896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940892.330553:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944976896:12345-0@lo:400:kworker.0 Request processed in 32us (4700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.330570:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788940892.330581:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788940892.330587:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839944977792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940892.330615:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839944977792:12345-0@lo:400:kworker.0 Request processed in 29us (3752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.330621:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788940892.330630:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788940892.330636:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944977408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940892.331477:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839944977408:12345-0@lo:400:kworker.0 Request processed in 837us (2905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.331486:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788940892.331504:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788940892.331511:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944977920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940892.331542:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839944977920:12345-0@lo:400:kworker.0 Request processed in 32us (2883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.331549:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788940892.331560:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788940892.331566:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944977536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940892.331596:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839944977536:12345-0@lo:400:kworker.0 Request processed in 30us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.331601:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788940892.331612:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788940892.331617:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944977664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940892.331657:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944977664:12345-0@lo:400:kworker.0 Request processed in 39us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.331674:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788940892.331726:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d018b0aa00 x1875839944977664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940892.331738:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944977664:0@lo:400:kworker.0 00000100:00100000:2.0:1788940892.333440:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944976384:0@lo:400:kworker.0 00010000:00080000:2.0:1788940892.333465:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08dd3480 x1875839944976896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940892.333478:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944976896:0@lo:400:kworker.0 00010000:00080000:2.0:1788940892.333493:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d018b08a80 x1875839944977408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940892.333501:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839944977408:0@lo:400:kworker.0 00010000:00080000:2.0:1788940892.333513:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d018b09f80 x1875839944977920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940892.333520:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839944977920:0@lo:400:kworker.0 00000100:00080000:2.0:1788940892.333596:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940892.333601:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940892.333605:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940892.333608:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940892.334368:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944978176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940892.334383:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944976768:0@lo:400:kworker.0 00000100:00100000:0.0:1788940892.334395:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944977280:0@lo:400:kworker.0 00010000:00080000:0.0:1788940892.334415:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d018b0b480 x1875839944977792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940892.334434:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839944977792:0@lo:400:kworker.0 00010000:00080000:2.0:1788940892.336630:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d018b09c00 x1875839944977536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940892.336661:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d018b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839944977536:0@lo:400:kworker.0 00000100:00100000:2.0:1788940892.336694:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944978048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940892.343366:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940892.345338:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921808384 00000100:00100000:2.0:1788940892.345358:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921808384 00000100:00100000:2.0:1788940892.345421:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:2.0:1788940892.345440:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1875839921808384:12345-192.168.202.25@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788940892.345479:0:18670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c6124d7c-7da2-46c0-b57e-23d795ef33aa@192.168.202.25@tcp t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:2.0:1788940892.345519:0:18670:0:(genops.c:1393:class_connect()) connect: client c6124d7c-7da2-46c0-b57e-23d795ef33aa, cookie 0x9c34acc08bade77b 00002000:00100000:2.0:1788940892.345535:0:18670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c6124d7c-7da2-46c0-b57e-23d795ef33aa/ffff91cf07e0d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788940892.345555:0:18670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788940892.345750:0:18670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788940892.345784:0:18670:0:(import.c:65:import_set_state_nolock()) ffff91cf07e0d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940892.345870:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:2403:x1875839921808384:12345-192.168.202.25@tcp:8:mount.lustre.0 Request processed in 430us (2514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940892.345878:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:0.0:1788940892.357875:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940892.358189:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921808640 00000100:00100000:3.0:1788940892.358199:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921808640 00000100:00100000:3.0:1788940892.358282:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:3.0:1788940892.358295:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:14964:x1875839921808640:12345-192.168.202.25@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788940892.358409:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:14964:x1875839921808640:12345-192.168.202.25@tcp:900:mount.lustre.0 Request processed in 117us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940892.358418:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:1.0:1788940892.358725:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940892.359816:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921808512 00000100:00100000:3.0:1788940892.359826:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921808512 00000100:00100000:3.0:1788940892.359871:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:3.0:1788940892.359878:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1875839921808512:12345-192.168.202.25@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788940892.359922:0:19149:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c6124d7c-7da2-46c0-b57e-23d795ef33aa@192.168.202.25@tcp t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:3.0:1788940892.359953:0:19149:0:(genops.c:1393:class_connect()) connect: client c6124d7c-7da2-46c0-b57e-23d795ef33aa, cookie 0x9c34acc08bade782 00002000:00100000:3.0:1788940892.359966:0:19149:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c6124d7c-7da2-46c0-b57e-23d795ef33aa/ffff91cf01632800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788940892.359977:0:19149:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1788940892.361610:0:19149:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788940892.362000:0:19149:0:(import.c:65:import_set_state_nolock()) ffff91cf01637000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940892.362072:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:2403:x1875839921808512:12345-192.168.202.25@tcp:8:mount.lustre.0 Request processed in 2190us (3345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940892.362084:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 20 00000001:00100000:2.0:1788940892.370189:0:19484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c6124d7c-7da2-46c0-b57e-23d795ef33aa 00000001:00080000:2.0:1788940892.370206:0:19484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:1.0:1788940892.371235:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940892.371478:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921808768 00000100:00100000:3.0:1788940892.371488:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921808768 00000100:00100000:3.0:1788940892.371542:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:3.0:1788940892.371553:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:14964:x1875839921808768:12345-192.168.202.25@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788940892.374652:0:17153:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3003us 00000004:00200000:1.0:1788940892.443696:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788940892.443917:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:14964:x1875839921808768:12345-192.168.202.25@tcp:33:mount.lustre.0 Request processed in 72355us (72678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940892.443936:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:0.0:1788940892.684465:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940892.684558:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921808896 00000100:00100000:1.0:1788940892.684574:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921808896 00000100:00100000:1.0:1788940892.684658:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:1.0:1788940892.684682:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:15010:x1875839921808896:12345-192.168.202.25@tcp:101:mkdir.0 00010000:00010000:1.0:1788940892.684733:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940892.684980:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053400/0x9c34acc08bade789 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7681 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940892.685085:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08bade790 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940892.685100:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08bade790 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940892.685117:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08bade790 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940892.685167:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788940892.685171:0:17152:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788940892.685206:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08bade790 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940892.685236:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053400/0x9c34acc08bade789 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7681 expref: 8 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940892.685449:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08bade790 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7681 expref: 7 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940892.685459:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfe300) 00010000:00010000:1.0:1788940892.685462:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940892.685466:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d042053a00, rc 0) 00000100:00100000:1.0:1788940892.685552:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+7:15010:x1875839921808896:12345-192.168.202.25@tcp:101:mkdir.0 Request processed in 883us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940892.685562:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 13 00010000:00010000:2.0:1788940893.023300:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940893.340464:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940893.340502:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944978304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940893.340605:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940893.340679:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944978304 00000100:00100000:1.0:1788940893.340692:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944978304 00000100:00100000:1.0:1788940893.340766:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788940893.340777:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944978304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940893.340802:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788940893.340882:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944978304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940893.340888:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940893.341122:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944978304:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788940894.044336:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940894.902427:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940894.902630:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921809024 00000100:00100000:3.0:1788940894.902641:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921809024 00000100:00100000:3.0:1788940894.902732:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:3.0:1788940894.902745:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+7:15063:x1875839921809024:12345-192.168.202.25@tcp:41:lfs.0 00000004:00000024:3.0:1788940894.902800:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:2.0:1788940894.903025:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940894.903195:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+7:15063:x1875839921809024:12345-192.168.202.25@tcp:41:lfs.0 Request processed in 452us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940894.903204:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:3.0:1788940894.910956:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940894.911631:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921809152 00000100:00100000:1.0:1788940894.911650:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921809152 00000100:00100000:1.0:1788940894.911750:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:1.0:1788940894.911761:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:15063:x1875839921809152:12345-192.168.202.25@tcp:41:lfs.0 00000004:00000024:1.0:1788940894.911817:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788940894.911947:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:15063:x1875839921809152:12345-192.168.202.25@tcp:41:lfs.0 Request processed in 187us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940894.911956:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00080000:2.0:1788940894.913125:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788940894.916199:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940894.916326:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921809280 00000100:00100000:1.0:1788940894.916342:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921809280 00000100:00100000:1.0:1788940894.916471:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:1.0:1788940894.916482:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:15063:x1875839921809280:12345-192.168.202.25@tcp:13:lfs.0 00002000:00000024:1.0:1788940894.916529:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788940894.916636:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:15063:x1875839921809280:12345-192.168.202.25@tcp:13:lfs.0 Request processed in 154us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940894.916644:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00080000:2.0:1788940894.916746:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940894.919190:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940894.919296:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921809408 00000100:00100000:1.0:1788940894.919321:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921809408 00000100:00100000:1.0:1788940894.919393:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:1.0:1788940894.919419:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:15063:x1875839921809408:12345-192.168.202.25@tcp:13:lfs.0 00002000:00000024:1.0:1788940894.919457:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788940894.919560:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:15063:x1875839921809408:12345-192.168.202.25@tcp:13:lfs.0 Request processed in 142us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940894.919569:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00080000:2.0:1788940894.920138:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788940895.068068:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940895.164789:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940895.165306:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921809536 00000100:00100000:1.0:1788940895.165322:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921809536 00000100:00100000:1.0:1788940895.165404:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 132 00000100:00100000:1.0:1788940895.165417:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d010d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+10:15095:x1875839921809536:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788940895.165442:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940895.165466:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d042053400/0x9c34acc08bade797 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7688 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940895.165517:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d042053400/0x9c34acc08bade797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7688 expref: 11 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940895.165532:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d042053400/0x9c34acc08bade797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7688 expref: 11 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940895.165544:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d042053400, rc 0) 00000100:00100000:1.0:1788940895.165627:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d010d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+11:15095:x1875839921809536:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 212us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940895.165635:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 132 00000100:00100000:0.0:1788940895.174525:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940895.174627:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921809664 00000100:00100000:3.0:1788940895.174642:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921809664 00000100:00100000:3.0:1788940895.174718:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 133 00000100:00100000:3.0:1788940895.174730:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+11:15095:x1875839921809664:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788940895.174950:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+11:15095:x1875839921809664:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 221us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940895.174958:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 133 00000100:00100000:3.0:1788940895.177314:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940895.177482:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921809792 00000100:00100000:0.0:1788940895.177513:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921809792 00000100:00100000:0.0:1788940895.177580:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 134 00000100:00100000:0.0:1788940895.177592:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+11:15095:x1875839921809792:12345-192.168.202.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788940895.177783:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+11:15095:x1875839921809792:12345-192.168.202.25@tcp:503:mount.lustre.0 Request processed in 193us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940895.177793:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 134 00000100:00100000:0.0:1788940895.185582:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940895.190136:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921809920 00000100:00100000:1.0:1788940895.190161:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921809920 00000100:00100000:1.0:1788940895.190251:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 135 00000100:00100000:1.0:1788940895.190308:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08583c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+11:15099:x1875839921809920:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788940895.190539:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08583c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+11:15099:x1875839921809920:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 241us (4973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940895.190549:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 135 00000100:00100000:1.0:1788940895.237787:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940895.237975:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921810048 00000100:00100000:3.0:1788940895.237988:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921810048 00000100:00100000:3.0:1788940895.238071:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 136 00000100:00100000:3.0:1788940895.238085:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+11:15099:x1875839921810048:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788940895.238365:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+11:15099:x1875839921810048:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 283us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940895.238376:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 136 00000100:00100000:3.0:1788940895.256455:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940895.256588:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921810176 00000100:00100000:0.0:1788940895.256602:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921810176 00000100:00100000:0.0:1788940895.256674:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 137 00000100:00100000:0.0:1788940895.256685:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08583450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+11:15099:x1875839921810176:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940895.256905:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08583450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+11:15099:x1875839921810176:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 221us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940895.256914:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 137 00000100:00100000:0.0:1788940895.276089:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940895.276331:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921810304 00000100:00100000:1.0:1788940895.276347:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921810304 00000100:00100000:1.0:1788940895.276416:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 138 00000100:00100000:1.0:1788940895.276428:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+11:15095:x1875839921810304:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788940895.276451:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940895.276475:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d042052000/0x9c34acc08bade79e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc76b9 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940895.276511:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d042052000/0x9c34acc08bade79e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76b9 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940895.276524:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d042052000/0x9c34acc08bade79e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76b9 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940895.276534:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d042052000, rc 0) 00000100:00100000:1.0:1788940895.276609:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+12:15095:x1875839921810304:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 184us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940895.276616:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 138 00000100:00100000:1.0:1788940895.292579:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940895.292693:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921810432 00000100:00100000:3.0:1788940895.292708:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921810432 00000100:00100000:3.0:1788940895.292783:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 139 00000100:00100000:3.0:1788940895.292796:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+12:15095:x1875839921810432:12345-192.168.202.25@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788940895.292868:0:17144:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788940895.292894:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788940895.292898:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788940895.292902:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788940895.292905:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788940895.292908:0:17144:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788940895.298006:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08582c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+12:15095:x1875839921810432:12345-192.168.202.25@tcp:256:mount.lustre.0 Request processed in 5196us (5426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940895.298027:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 139 00000100:00100000:0.0:1788940895.321617:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940895.321793:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921810560 00000100:00100000:2.0:1788940895.321826:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921810560 00000100:00100000:2.0:1788940895.321903:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 140 00000100:00100000:2.0:1788940895.321917:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08583050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+12:15095:x1875839921810560:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788940895.321956:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940895.321980:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0027f6800/0x9c34acc08bade7a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc76c0 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940895.322019:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0027f6800/0x9c34acc08bade7a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76c0 expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940895.322033:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0027f6800/0x9c34acc08bade7a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76c0 expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940895.322045:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f6800, rc 0) 00000100:00100000:2.0:1788940895.322124:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08583050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:15095:x1875839921810560:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 210us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940895.322131:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 140 00000100:00100000:1.0:1788940895.327416:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940895.327521:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921810688 00000100:00100000:0.0:1788940895.327533:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921810688 00000100:00100000:0.0:1788940895.327600:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 141 00000100:00100000:0.0:1788940895.327612:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:15095:x1875839921810688:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788940895.329204:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08580450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:15095:x1875839921810688:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 1581us (1789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940895.329242:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 141 00000100:00100000:3.0:1788940895.333572:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940895.339317:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921810816 00000100:00100000:1.0:1788940895.339342:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921810816 00000100:00100000:1.0:1788940895.339532:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 142 00000100:00100000:1.0:1788940895.339567:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:15095:x1875839921810816:12345-192.168.202.25@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788940895.339790:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08580c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:15095:x1875839921810816:12345-192.168.202.25@tcp:503:mount.lustre.0 Request processed in 225us (6232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940895.339800:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 142 00000100:00100000:3.0:1788940895.353388:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940895.353789:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921810944 00000100:00100000:0.0:1788940895.353804:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921810944 00000100:00100000:0.0:1788940895.353897:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 143 00000100:00100000:0.0:1788940895.353912:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:15106:x1875839921810944:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940895.354140:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:15106:x1875839921810944:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 232us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940895.354150:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 143 00000100:00100000:0.0:1788940895.363451:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940895.363550:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921811072 00000100:00100000:1.0:1788940895.363562:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921811072 00000100:00100000:1.0:1788940895.363640:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 144 00000100:00100000:1.0:1788940895.363654:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:15106:x1875839921811072:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788940895.363860:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:15106:x1875839921811072:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 209us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940895.363867:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 144 00000100:00100000:3.0:1788940895.378522:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940895.378750:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921811200 00000100:00100000:2.0:1788940895.378766:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921811200 00000100:00100000:2.0:1788940895.378835:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:2.0:1788940895.378847:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875839921811200:12345-192.168.202.25@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788940895.378886:0:17150:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 50c55b2b-64be-4d2b-a01b-9a1815d64f2a@192.168.202.25@tcp t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:2.0:1788940895.378944:0:17150:0:(genops.c:1393:class_connect()) connect: client 50c55b2b-64be-4d2b-a01b-9a1815d64f2a, cookie 0x9c34acc08bade7ac 00000004:00100000:2.0:1788940895.378982:0:17150:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1788940895.379108:0:17150:0:(import.c:65:import_set_state_nolock()) ffff91cf07e0a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940895.379191:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2403:x1875839921811200:12345-192.168.202.25@tcp:38:mount.lustre.0 Request processed in 345us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940895.379218:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:3.0:1788940895.380125:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940895.380228:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921811456 00000100:00100000:1.0:1788940895.380238:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921811456 00000100:00100000:1.0:1788940895.380318:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:1.0:1788940895.380327:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875839921811456:12345-192.168.202.25@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788940895.380359:0:17152:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 50c55b2b-64be-4d2b-a01b-9a1815d64f2a@192.168.202.25@tcp t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:1.0:1788940895.380404:0:17152:0:(genops.c:1393:class_connect()) connect: client 50c55b2b-64be-4d2b-a01b-9a1815d64f2a, cookie 0x9c34acc08bade7b3 00000004:00100000:1.0:1788940895.380438:0:17152:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:1.0:1788940895.380557:0:17152:0:(import.c:65:import_set_state_nolock()) ffff91cf06074000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940895.380613:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2403:x1875839921811456:12345-192.168.202.25@tcp:38:mount.lustre.0 Request processed in 286us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940895.380622:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:0.0:1788940895.389530:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944978432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788940895.389581:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944978688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940895.389683:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944978560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788940895.393806:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940895.393827:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940895.393908:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944978688 00000100:00100000:3.0:1788940895.393921:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944978688 00000100:00100000:3.0:1788940895.393996:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788940895.394009:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944978688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788940895.394053:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1788940895.394162:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940895.394200:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944978560 00000100:00100000:2.0:1788940895.394203:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944978560 00000100:00100000:2.0:1788940895.394243:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788940895.394275:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944978560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940895.394306:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788940895.394348:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944978560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940895.394355:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788940895.395190:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944978560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788940895.396911:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944978688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2892us (3101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940895.396928:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788940895.405550:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940895.406024:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944978688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940895.406283:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940895.406336:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940895.406374:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944978432 00000100:00100000:0.0:1788940895.406384:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940895.406405:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944978432 00000100:00100000:2.0:1788940895.406467:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788940895.406479:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944978432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788940895.406516:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788940895.406592:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921811712 00000100:00100000:1.0:1788940895.406598:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921811712 00000100:00100000:2.0:1788940895.406611:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944978432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940895.406619:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788940895.407823:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944978432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940895.407952:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921811584 00000100:00100000:1.0:1788940895.407960:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921811584 00000100:00100000:3.0:1788940895.412056:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921811328 00000100:00100000:3.0:1788940895.412079:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921811328 00000100:00100000:3.0:1788940895.412164:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:3.0:1788940895.412177:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+7:15095:x1875839921811712:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788940895.412236:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788940895.412658:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+7:15095:x1875839921811712:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 481us (6375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940895.412668:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:3.0:1788940895.412698:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:3.0:1788940895.412708:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:0:x1875839921811584:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788940895.412750:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788940895.412784:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:0:x1875839921811584:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 79us (6448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940895.412791:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:3.0:1788940895.412805:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:3.0:1788940895.412812:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:0:x1875839921811328:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788940895.412824:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788940895.412848:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:0:x1875839921811328:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 36us (6470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940895.412854:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00080000:3.0:1788940895.412922:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788940895.412927:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940895.423844:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940895.423967:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921811840 00000100:00100000:0.0:1788940895.423983:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921811840 00000100:00100000:0.0:1788940895.424064:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:0.0:1788940895.424077:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:15095:x1875839921811840:12345-192.168.202.25@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788940895.424208:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:15095:x1875839921811840:12345-192.168.202.25@tcp:40:mount.lustre.0 Request processed in 133us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940895.424216:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:2.0:1788940895.446549:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940895.446615:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940895.446687:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940895.446913:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921811968 00000100:00100000:3.0:1788940895.446929:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921811968 00000100:00100000:3.0:1788940895.446984:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921812096 00000100:00100000:3.0:1788940895.446988:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921812096 00000100:00100000:3.0:1788940895.447009:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:3.0:1788940895.447020:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1875839921811968:12345-192.168.202.25@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788940895.447068:0:18668:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 50c55b2b-64be-4d2b-a01b-9a1815d64f2a@192.168.202.25@tcp t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:3.0:1788940895.447112:0:18668:0:(genops.c:1393:class_connect()) connect: client 50c55b2b-64be-4d2b-a01b-9a1815d64f2a, cookie 0x9c34acc08bade7ba 00002000:00100000:3.0:1788940895.447127:0:18668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 50c55b2b-64be-4d2b-a01b-9a1815d64f2a/ffff91d03473c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788940895.447141:0:18668:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000100:00100000:2.0:1788940895.447490:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:2.0:1788940895.447499:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1875839921812096:12345-192.168.202.25@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788940895.447524:0:18669:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 50c55b2b-64be-4d2b-a01b-9a1815d64f2a@192.168.202.25@tcp t0 exp 0000000000000000 cur 650 last 0 00002000:00080000:3.0:1788940895.447530:0:18668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:00000080:2.0:1788940895.447553:0:18669:0:(genops.c:1393:class_connect()) connect: client 50c55b2b-64be-4d2b-a01b-9a1815d64f2a, cookie 0x9c34acc08bade7c1 00002000:00100000:2.0:1788940895.447560:0:18669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 50c55b2b-64be-4d2b-a01b-9a1815d64f2a/ffff91cf07e0b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788940895.447569:0:18669:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00000100:00080000:3.0:1788940895.447574:0:18668:0:(import.c:65:import_set_state_nolock()) ffff91d03473e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940895.447670:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2403:x1875839921811968:12345-192.168.202.25@tcp:8:mount.lustre.0 Request processed in 650us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940895.447692:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00002000:00080000:2.0:1788940895.447779:0:18669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788940895.447801:0:18669:0:(import.c:65:import_set_state_nolock()) ffff91cf07e0e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940895.447828:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2403:x1875839921812096:12345-192.168.202.25@tcp:8:mount.lustre.0 Request processed in 329us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940895.447836:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:1.0:1788940895.448406:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921812224 00000100:00100000:1.0:1788940895.448416:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921812224 00000100:00100000:1.0:1788940895.448471:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:1.0:1788940895.448481:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:15095:x1875839921812224:12345-192.168.202.25@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788940895.448530:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:15095:x1875839921812224:12345-192.168.202.25@tcp:900:mount.lustre.0 Request processed in 50us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940895.448537:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:3.0:1788940895.451205:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940895.451349:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921812352 00000100:00100000:0.0:1788940895.451363:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921812352 00000100:00100000:0.0:1788940895.451456:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:0.0:1788940895.451468:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:15095:x1875839921812352:12345-192.168.202.25@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788940895.451603:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788940895.451842:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:15095:x1875839921812352:12345-192.168.202.25@tcp:33:mount.lustre.0 Request processed in 376us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940895.451852:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 1 00000040:00080000:1.0:1788940895.516519:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788940895.636657:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940895.636898:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921812480 00000100:00100000:1.0:1788940895.636913:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921812480 00000100:00100000:1.0:1788940895.637111:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:1.0:1788940895.637125:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:15129:x1875839921812480:12345-192.168.202.25@tcp:101:mkdir.0 00010000:00010000:1.0:1788940895.637159:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940895.637193:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053000/0x9c34acc08bade7c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc76f1 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940895.637365:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053600/0x9c34acc08bade7cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940895.637382:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053600/0x9c34acc08bade7cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940895.637397:0:18958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053600/0x9c34acc08bade7cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940895.637482:0:18958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788940895.637487:0:18958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788940895.637514:0:18958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053600/0x9c34acc08bade7cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940895.637547:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053000/0x9c34acc08bade7c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76f1 expref: 8 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940895.637569:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053600/0x9c34acc08bade7cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76f1 expref: 7 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940895.637578:0:18958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfe300) 00010000:00010000:1.0:1788940895.637582:0:18958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940895.637586:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d042053600, rc 0) 00000100:00100000:1.0:1788940895.637670:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+7:15129:x1875839921812480:12345-192.168.202.25@tcp:101:mkdir.0 Request processed in 548us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940895.637678:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00010000:00010000:2.0:1788940896.091504:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940897.117039:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940897.436164:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:303c4994-a6d4-4c7c-823f-eb7dad50725e:3648:1875839944978816:0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.437356:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944978944:0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.437422:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940897.437490:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944979456:0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.437511:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940897.437530:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944979968:0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.437555:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940897.437574:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944980480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940897.437597:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940897.437641:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788940897.437648:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944979072:0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.437674:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940897.437694:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944979584:0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.437715:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940897.437733:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944980096:0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.437753:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940897.437784:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944979200:0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.437808:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940897.437827:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944979712:0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.437863:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940897.437881:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944980224:0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.437909:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940897.437948:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944978944 00000100:00100000:1.0:1788940897.437958:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944978944 00000100:00100000:1.0:1788940897.438008:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944979456 00000100:00100000:1.0:1788940897.438012:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944979456 00000100:00100000:1.0:1788940897.438030:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788940897.438039:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944978944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.438102:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944978944:12345-0@lo:400:kworker.0 Request processed in 63us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940897.438110:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788940897.438130:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788940897.438136:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944979456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.438164:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944979456:12345-0@lo:400:kworker.0 Request processed in 28us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940897.438182:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788940897.438204:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944980480 00000100:00100000:1.0:1788940897.438207:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944980480 00000100:00100000:1.0:1788940897.438254:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788940897.438304:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944980480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940897.438335:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788940897.438370:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944980480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940897.438377:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788940897.438395:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944979072 00000100:00100000:1.0:1788940897.438398:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944979072 00000100:00100000:1.0:1788940897.438421:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944979584 00000100:00100000:1.0:1788940897.438424:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944979584 00000100:00100000:1.0:1788940897.438434:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944979200 00000100:00100000:1.0:1788940897.438436:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944979200 00000100:00100000:1.0:1788940897.438444:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944979712 00000100:00100000:1.0:1788940897.438446:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944979712 00000100:00100000:1.0:1788940897.438459:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940897.438466:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944979072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.438496:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944979072:12345-0@lo:400:kworker.0 Request processed in 31us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940897.438503:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940897.438513:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788940897.438518:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944979584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.438542:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944979584:12345-0@lo:400:kworker.0 Request processed in 24us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940897.438548:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788940897.438567:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788940897.438572:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944979200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.438605:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944979200:12345-0@lo:400:kworker.0 Request processed in 33us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940897.438611:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788940897.438621:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788940897.438627:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944979712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.438651:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944979712:12345-0@lo:400:kworker.0 Request processed in 25us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940897.438657:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788940897.438680:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944979968 00000100:00100000:1.0:1788940897.438683:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944979968 00000100:00100000:1.0:1788940897.438711:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944980096 00000100:00100000:1.0:1788940897.438714:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944980096 00000100:00100000:1.0:1788940897.438725:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944980224 00000100:00100000:1.0:1788940897.438728:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944980224 00000100:00100000:1.0:1788940897.438742:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788940897.438749:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944979968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.438780:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944979968:12345-0@lo:400:kworker.0 Request processed in 32us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940897.438786:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788940897.438797:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788940897.438804:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944980096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.438832:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944980096:12345-0@lo:400:kworker.0 Request processed in 28us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940897.438838:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788940897.438848:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788940897.438861:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944980224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.438889:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944980224:12345-0@lo:400:kworker.0 Request processed in 29us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940897.438894:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1788940897.438929:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940897.438934:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940897.438938:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940897.438940:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940897.438993:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788940897.439016:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944979200:0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.439030:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944979712:0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.439041:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944980224:0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.439077:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944979072:0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.439092:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944979584:0@lo:400:kworker.0 00010000:00080000:1.0:1788940897.439108:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08dcce00 x1875839944980096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940897.439123:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944980096:0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.439136:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944978944:0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.439146:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944979456:0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.439158:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944979968:0@lo:400:kworker.0 00000100:00100000:1.0:1788940897.439175:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944980480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940897.439464:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940897.439511:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944979328:0@lo:400:kworker.0 00000100:00100000:0.0:1788940897.439552:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940897.439572:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944979840:0@lo:400:kworker.0 00000100:00100000:0.0:1788940897.439593:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940897.439611:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944980352:0@lo:400:kworker.0 00000100:00100000:0.0:1788940897.439633:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940897.439677:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944979328 00000100:00100000:0.0:1788940897.439682:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944979328 00000100:00100000:0.0:1788940897.439706:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944979840 00000100:00100000:0.0:1788940897.439708:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944979840 00000100:00100000:0.0:1788940897.439719:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944980352 00000100:00100000:0.0:1788940897.439721:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944980352 00000100:00100000:0.0:1788940897.439747:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788940897.439753:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944979328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940897.439797:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875839944979328:12345-0@lo:400:kworker.0 Request processed in 43us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940897.439804:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788940897.439832:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788940897.439903:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944979840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940897.439935:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944979840:12345-0@lo:400:kworker.0 Request processed in 97us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940897.439942:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788940897.439954:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788940897.439959:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944980352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940897.439985:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944980352:12345-0@lo:400:kworker.0 Request processed in 26us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940897.439992:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788940897.440031:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944978816 00000100:00100000:0.0:1788940897.440036:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944978816 00000100:00100000:0.0:1788940897.440065:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788940897.440072:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3648:x1875839944978816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940897.440123:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3648:x1875839944978816:12345-0@lo:400:kworker.0 Request processed in 51us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940897.440130:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:0.0:1788940897.440168:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788940897.440196:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:303c4994-a6d4-4c7c-823f-eb7dad50725e:3648:1875839944978816:0@lo:400:kworker.0 00000100:00100000:0.0:1788940897.440209:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875839944979328:0@lo:400:kworker.0 00000100:00100000:0.0:1788940897.440218:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944979840:0@lo:400:kworker.0 00010000:00080000:0.0:1788940897.440230:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08dce680 x1875839944980352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940897.440240:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944980352:0@lo:400:kworker.0 00000001:00100000:0.0:1788940897.451637:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 50c55b2b-64be-4d2b-a01b-9a1815d64f2a 00000001:00100000:0.0:1788940897.451665:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c6124d7c-7da2-46c0-b57e-23d795ef33aa 00000100:00100000:2.0:1788940897.452517:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940897.452548:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944980608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940897.452647:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940897.452710:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944980608 00000100:00100000:2.0:1788940897.452720:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944980608 00000100:00100000:2.0:1788940897.452781:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940897.452792:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944980608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788940897.452826:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788940897.452878:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944980608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940897.452885:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940897.452938:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944980608:0@lo:13:osp-pre-1-1.0 00000001:00100000:3.0:1788940897.456292:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 50c55b2b-64be-4d2b-a01b-9a1815d64f2a 00000001:00100000:3.0:1788940897.456308:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c6124d7c-7da2-46c0-b57e-23d795ef33aa 00000001:00100000:0.0:1788940897.456415:0:18664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 50c55b2b-64be-4d2b-a01b-9a1815d64f2a 00000001:00100000:0.0:1788940897.456424:0:18664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c6124d7c-7da2-46c0-b57e-23d795ef33aa 00010000:00010000:0.0:1788940898.141142:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940898.459554:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940898.459589:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944980736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940898.459688:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940898.460011:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944980736 00000100:00100000:0.0:1788940898.460022:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944980736 00000100:00100000:0.0:1788940898.460123:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788940898.460135:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944980736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940898.460179:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788940898.460243:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944980736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940898.460252:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788940898.460452:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944980736:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788940898.784442:0:20039:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788940899.163919:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940900.190073:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940900.515178:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940900.515223:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944980864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940900.515352:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940900.515443:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944980864 00000100:00100000:1.0:1788940900.515454:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944980864 00000100:00100000:1.0:1788940900.515512:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788940900.515523:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944980864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788940900.515573:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788940900.515628:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944980864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940900.515635:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788940900.515706:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944980864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788940900.517879:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d001378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944980992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788940900.517972:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940900.518040:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940900.518047:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944981120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788940900.518077:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940900.520471:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944981120 00000100:00100000:0.0:1788940900.520496:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944981120 00000100:00100000:0.0:1788940900.520574:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788940900.520586:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944981120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788940900.520640:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788940900.520755:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944981120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 171us (2676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940900.520762:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788940900.521105:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944981120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788940900.521238:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944980992 00000100:00100000:1.0:1788940900.521245:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944980992 00000100:00100000:1.0:1788940900.521354:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788940900.521365:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944980992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788940900.521394:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788940900.521448:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944980992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (3477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940900.521456:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788940900.521738:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940900.521780:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d001378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944980992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788940900.645720:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940900.645772:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940900.645798:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940900.645820:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940900.645849:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940900.645869:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940900.645888:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940900.645906:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940900.645931:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940900.645966:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921812992 00000100:00100000:2.0:1788940900.645979:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921812992 00000100:00100000:2.0:1788940900.646052:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921813504 00000100:00100000:2.0:1788940900.646055:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921813504 00000100:00100000:2.0:1788940900.646069:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921813120 00000100:00100000:2.0:1788940900.646071:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921813120 00000100:00100000:2.0:1788940900.646083:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921813632 00000100:00100000:2.0:1788940900.646085:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921813632 00000100:00100000:2.0:1788940900.646101:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:2.0:1788940900.646113:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2406:x1875839921812992:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940900.646214:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2406:x1875839921812992:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 103us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940900.646238:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:2.0:1788940900.646289:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:2.0:1788940900.646296:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2406:x1875839921813504:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940900.646323:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2406:x1875839921813504:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 28us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940900.646330:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:2.0:1788940900.646343:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:2.0:1788940900.646349:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2406:x1875839921813120:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940900.646372:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2406:x1875839921813120:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940900.646378:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:2.0:1788940900.646389:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:2.0:1788940900.646396:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2406:x1875839921813632:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940900.646420:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2406:x1875839921813632:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 24us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940900.646426:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:2.0:1788940900.646446:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921812736 00000100:00100000:2.0:1788940900.646451:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921812736 00000100:00100000:2.0:1788940900.646475:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921813248 00000100:00100000:2.0:1788940900.646478:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921813248 00000100:00100000:2.0:1788940900.646487:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921812864 00000100:00100000:2.0:1788940900.646489:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921812864 00000100:00100000:2.0:1788940900.646500:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921813376 00000100:00100000:2.0:1788940900.646502:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921813376 00000100:00100000:2.0:1788940900.646514:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00100000:2.0:1788940900.646529:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:2406:x1875839921812736:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940900.646558:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:2406:x1875839921812736:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 30us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940900.646564:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00100000:2.0:1788940900.646576:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:2.0:1788940900.646582:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2406:x1875839921813248:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940900.646606:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2406:x1875839921813248:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 24us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940900.646613:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:2.0:1788940900.646623:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:2.0:1788940900.646629:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2406:x1875839921812864:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940900.646650:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2406:x1875839921812864:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 22us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940900.646656:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:2.0:1788940900.646667:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 48 00000100:00100000:2.0:1788940900.646673:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2406:x1875839921813376:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940900.646695:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2406:x1875839921813376:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 22us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940900.646701:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 48 00000100:00100000:2.0:1788940900.646725:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921812608 00000100:00100000:2.0:1788940900.646729:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921812608 00000100:00100000:2.0:1788940900.646758:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 146 00000100:00100000:2.0:1788940900.646764:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:2406:x1875839921812608:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940900.646794:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:2406:x1875839921812608:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 31us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940900.646801:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 146 00000100:00080000:2.0:1788940900.646847:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940900.646852:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940900.646855:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940900.646857:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788940901.211719:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940901.343893:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1788940901.539498:0:19484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 50c55b2b-64be-4d2b-a01b-9a1815d64f2a 00010000:00010000:2.0:1788940902.241617:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940902.558519:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940902.558547:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944981248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940902.558651:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940902.559027:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944981248 00000100:00100000:1.0:1788940902.559039:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944981248 00000100:00100000:1.0:1788940902.559116:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788940902.559130:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944981248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788940902.559172:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788940902.559274:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944981248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940902.559283:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788940902.559332:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940902.559382:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944981248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940902.563290:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944981504:0@lo:400:kworker.0 00000100:00100000:2.0:1788940902.563397:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940902.563442:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944982016:0@lo:400:kworker.0 00000100:00100000:2.0:1788940902.563474:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940902.563559:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944982528:0@lo:400:kworker.0 00000100:00100000:2.0:1788940902.563602:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940902.563633:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788940902.563640:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944981632:0@lo:400:kworker.0 00000100:00100000:2.0:1788940902.563668:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940902.563702:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944982144:0@lo:400:kworker.0 00000100:00100000:2.0:1788940902.563725:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940902.563743:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944982656:0@lo:400:kworker.0 00000100:00100000:2.0:1788940902.563764:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940902.563825:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944982016 00000100:00100000:2.0:1788940902.563835:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944982016 00000100:00100000:2.0:1788940902.563891:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944982528 00000100:00100000:2.0:1788940902.563894:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944982528 00000100:00100000:2.0:1788940902.563918:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944982656 00000100:00100000:2.0:1788940902.563921:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944982656 00000100:00100000:2.0:1788940902.563941:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788940902.563950:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944982016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940902.564028:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944982016:12345-0@lo:400:kworker.0 Request processed in 77us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940902.564036:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788940902.564056:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788940902.564062:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944982528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940902.564088:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944982528:12345-0@lo:400:kworker.0 Request processed in 27us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940902.564094:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788940902.564107:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788940902.564113:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944982656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940902.564142:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944982656:12345-0@lo:400:kworker.0 Request processed in 30us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940902.564147:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788940902.564170:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944981632 00000100:00100000:2.0:1788940902.564173:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944981632 00000100:00100000:2.0:1788940902.564197:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944982144 00000100:00100000:2.0:1788940902.564200:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944982144 00000100:00100000:2.0:1788940902.564213:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788940902.564219:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944981632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940902.564279:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944981632:12345-0@lo:400:kworker.0 Request processed in 61us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940902.564292:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788940902.564304:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788940902.564310:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944982144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940902.564338:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944982144:12345-0@lo:400:kworker.0 Request processed in 30us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940902.564344:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788940902.564389:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944981632:0@lo:400:kworker.0 00000100:00100000:2.0:1788940902.564400:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944982144:0@lo:400:kworker.0 00010000:00080000:2.0:1788940902.564411:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf086cb100 x1875839944982656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940902.564421:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944982656:0@lo:400:kworker.0 00000100:00100000:2.0:1788940902.564431:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944982016:0@lo:400:kworker.0 00000100:00100000:2.0:1788940902.564440:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944982528:0@lo:400:kworker.0 00000100:00100000:0.0:1788940902.565057:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944981504 00000100:00100000:0.0:1788940902.565066:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944981504 00000100:00100000:0.0:1788940902.565109:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788940902.565117:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3645:x1875839944981504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940902.565181:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3645:x1875839944981504:12345-0@lo:400:kworker.0 Request processed in 65us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940902.565187:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788940902.565271:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944981504:0@lo:400:kworker.0 00000100:00100000:1.0:1788940902.568167:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944981760:0@lo:400:kworker.0 00000100:00100000:1.0:1788940902.568304:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940902.568357:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944981760 00000100:00100000:1.0:1788940902.568364:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944982272:0@lo:400:kworker.0 00000100:00100000:0.0:1788940902.568369:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944981760 00000100:00100000:1.0:1788940902.568388:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940902.568408:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944982784:0@lo:400:kworker.0 00000100:00100000:1.0:1788940902.568434:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940902.568444:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944982272 00000100:00100000:0.0:1788940902.568448:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944982272 00000100:00100000:1.0:1788940902.568459:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788940902.568467:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944981376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940902.568471:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788940902.568481:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944981760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940902.568492:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940902.568508:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944981888:0@lo:400:kworker.0 00000100:00100000:1.0:1788940902.568527:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940902.568539:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944982400:0@lo:400:kworker.0 00000100:00100000:0.0:1788940902.568553:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944981760:12345-0@lo:400:kworker.0 Request processed in 74us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940902.568557:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940902.568562:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788940902.568580:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944981888 00000100:00100000:0.0:1788940902.568583:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944981888 00000100:00100000:1.0:1788940902.568596:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944982912:0@lo:400:kworker.0 00000100:00100000:0.0:1788940902.568601:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788940902.568606:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944982272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940902.568625:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940902.568631:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944982272:12345-0@lo:400:kworker.0 Request processed in 25us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940902.568637:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788940902.568648:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788940902.568653:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944981888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940902.568675:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944981760:0@lo:400:kworker.0 00000100:00100000:1.0:1788940902.568686:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944982272:0@lo:400:kworker.0 00000100:00100000:0.0:1788940902.568696:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944981888:12345-0@lo:400:kworker.0 Request processed in 43us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940902.568701:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788940902.568719:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944981888:0@lo:400:kworker.0 00000100:00100000:1.0:1788940902.568771:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944982784 00000100:00100000:1.0:1788940902.568775:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944982784 00000100:00100000:1.0:1788940902.568799:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944982400 00000100:00100000:1.0:1788940902.568802:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944982400 00000100:00100000:1.0:1788940902.568825:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944982912 00000100:00100000:1.0:1788940902.568828:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944982912 00000100:00100000:1.0:1788940902.568842:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788940902.568848:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944982784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940902.568895:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944982784:12345-0@lo:400:kworker.0 Request processed in 47us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940902.568901:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788940902.568914:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788940902.568920:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944982400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940902.568947:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944982400:12345-0@lo:400:kworker.0 Request processed in 28us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940902.569678:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944982400:0@lo:400:kworker.0 00000100:00100000:0.0:1788940902.569694:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944982784:0@lo:400:kworker.0 00000100:00100000:1.0:1788940902.570060:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788940902.570084:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788940902.570096:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944982912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940902.570175:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944982912:12345-0@lo:400:kworker.0 Request processed in 84us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940902.570180:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788940902.570212:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940902.570218:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940902.570221:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788940902.570224:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940902.570267:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944981376 00000100:00100000:1.0:1788940902.570274:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944981376 00010000:00080000:0.0:1788940902.570297:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf086c9f80 x1875839944982912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940902.570309:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788940902.570310:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944982912:0@lo:400:kworker.0 00000100:00100000:1.0:1788940902.570315:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944981376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940902.570334:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788940902.570381:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944981376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (1888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940902.570401:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788940902.570412:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944981376:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1788940902.989130:0:20187:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6ef65870 20000000:00000080:2.0:1788940902.989156:0:20187:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91d0065dcc00 uarg=0000000000000000 20000000:01000000:2.0:1788940902.989223:0:20187:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788940902.989518:0:20187:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788940902.989525:0:20187:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788940902.990739:0:20188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788940902.991157:0:20187:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788940903.004456:0:20187:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788940903.004772:0:20187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7d6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.004919:0:20187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584d000/0x9c34acc08bade46b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade464 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.004947:0:20187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584c000/0x9c34acc08bade479 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade472 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.004955:0:20187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d001219200/0x9c34acc08bade4b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade4b1 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.004962:0:20187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d004602000/0x9c34acc08bade616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade60f expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.004973:0:20187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584dc00/0x9c34acc08bade766 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7650 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.004980:0:20187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d0027f6800/0x9c34acc08bade7a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76c0 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.004989:0:20187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7d6 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.005049:0:20187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d0027f6800/0x9c34acc08bade7a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76c0 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.005069:0:20187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d0027f6800/0x9c34acc08bade7a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76c0 expref: 12 pid: 17145 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940903.005090:0:20187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20187:1875839944983040:192.168.202.25@tcp:104: 00010000:00010000:2.0:1788940903.005681:0:20187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584dc00/0x9c34acc08bade766 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7650 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.005693:0:20187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584dc00/0x9c34acc08bade766 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7650 expref: 12 pid: 17145 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940903.005713:0:20187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20187:1875839944983168:192.168.202.25@tcp:104: 00010000:00010000:2.0:1788940903.005757:0:20187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d004602000/0x9c34acc08bade616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08bade60f expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.005766:0:20187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d004602000/0x9c34acc08bade616 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08bade60f expref: 23 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940903.005775:0:20187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086cb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20187:1875839944983296:0@lo:104: 00000100:00100000:2.0:1788940903.006995:0:20187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788940903.007111:0:20187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d001219200/0x9c34acc08bade4b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08bade4b1 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.007123:0:20187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d001219200/0x9c34acc08bade4b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08bade4b1 expref: 23 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940903.007135:0:20187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20187:1875839944983424:0@lo:104: 00000100:00100000:2.0:1788940903.007178:0:20187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940903.010929:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944983296 00000100:00100000:0.0:1788940903.013937:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944983296 00000100:00100000:3.0:1788940903.014726:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944983424 00000100:00100000:3.0:1788940903.014741:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944983424 00000100:00100000:3.0:1788940903.015318:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788940903.015333:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+4:20187:x1875839944983424:12345-0@lo:104: 00010000:00010000:3.0:1788940903.015362:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d001219c00/0x9c34acc08bade4b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade4b8 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940903.015484:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940903.015491:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+4:20187:x1875839944983424:12345-0@lo:104: Request processed in 163us (8311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940903.015498:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940903.015857:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940903.015891:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921813760 00000100:00100000:1.0:1788940903.015897:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921813760 00010000:00010000:1.0:1788940903.015925:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d0027f6800/0x9c34acc08bade7a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76c0 expref: 13 pid: 17145 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940903.015962:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:1.0:1788940903.015970:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:2404:x1875839921813760:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940903.015983:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940903.015989:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d0027f6800/0x9c34acc08bade7a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76c0 expref: 13 pid: 17145 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940903.016008:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d0027f6800/0x9c34acc08bade7a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76c0 expref: 13 pid: 17145 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940903.016034:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940903.016080:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:2404:x1875839921813760:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 111us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940903.016088:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 9 00010000:00010000:2.0:1788940903.016363:0:20187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584c000/0x9c34acc08bade479 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08bade472 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.016377:0:20187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584c000/0x9c34acc08bade479 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08bade472 expref: 23 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940903.016394:0:20187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20187:1875839944983552:0@lo:104: 00000100:00100000:2.0:1788940903.016441:0:20187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788940903.016499:0:20187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584d000/0x9c34acc08bade46b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08bade464 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.016531:0:20187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584d000/0x9c34acc08bade46b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08bade464 expref: 23 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940903.016541:0:20187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20187:1875839944983680:0@lo:104: 00000100:00100000:2.0:1788940903.016566:0:20187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940903.016578:0:20187:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d030d49c00 going to sleep for 11 seconds 00010000:00010000:2.0:1788940903.016607:0:20187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0027f6800/0x9c34acc08bade7a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76c0 expref: 12 pid: 17145 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940903.016622:0:20187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20187:1875839944983040:192.168.202.25@tcp:104: 00000100:00100000:2.0:1788940903.016631:0:20187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20187:1875839944983168:192.168.202.25@tcp:104: 00000100:00100000:2.0:1788940903.016639:0:20187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20187:1875839944983424:0@lo:104: 00010000:00010000:1.0:1788940903.017340:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940903.017352:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d001219c00/0x9c34acc08bade4b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade4b8 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940903.017362:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219c00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940903.017367:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d001219c00/0x9c34acc08bade4b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08bade4b8 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940903.017393:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d001219c00/0x9c34acc08bade4b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08bade4b8 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940903.017400:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d001219c00/0x9c34acc08bade4b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08bade4b8 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940903.017407:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788940903.017452:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d001219c00/0x9c34acc08bade4b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade4b8 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940903.017459:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940903.017486:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d001219c00/0x9c34acc08bade4b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade4b8 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940903.017494:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d001219c00/0x9c34acc08bade4b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade4b8 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940903.017518:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940903.017520:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940903.017522:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940903.017532:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940903.017549:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d001379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:303c4994-a6d4-4c7c-823f-eb7dad50725e:3646:1875839944983808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940903.017595:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940903.018198:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944983552 00000100:00100000:0.0:1788940903.018208:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944983552 00000100:00100000:0.0:1788940903.018245:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944983680 00000100:00100000:0.0:1788940903.018249:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944983680 00000100:00100000:3.0:1788940903.018359:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788940903.018371:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+5:20187:x1875839944983296:12345-0@lo:104: 00010000:00010000:3.0:1788940903.018385:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08bade60f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade616 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940903.018553:0:20187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086cb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20187:1875839944983296:0@lo:104: 00010000:00010000:3.0:1788940903.018643:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940903.018659:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+5:20187:x1875839944983296:12345-0@lo:104: Request processed in 282us (11660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940903.018667:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788940903.018687:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788940903.018695:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+4:20187:x1875839944983552:12345-0@lo:104: 00010000:00010000:3.0:1788940903.018703:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08bade472 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade479 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940903.018776:0:20187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20187:1875839944983552:0@lo:104: 00000100:00100000:0.0:1788940903.018998:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944983808 00000100:00100000:0.0:1788940903.019003:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944983808 00010000:00010000:0.0:1788940903.019023:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d001219200/0x9c34acc08bade4b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade4b1 expref: 24 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940903.019054:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940903.019060:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3646:x1875839944983808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940903.019071:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940903.019076:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d001219200/0x9c34acc08bade4b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade4b1 expref: 24 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940903.019098:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d001219200/0x9c34acc08bade4b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08bade4b1 expref: 24 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940903.019115:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d001219200/0x9c34acc08bade4b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08bade4b1 expref: 24 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940903.019131:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940903.019167:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:3646:x1875839944983808:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940903.019173:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940903.019222:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d001379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:303c4994-a6d4-4c7c-823f-eb7dad50725e:3646:1875839944983808:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940903.019440:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940903.019448:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08bade60f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade616 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940903.019456:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218600 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940903.019459:0:18693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08bade60f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08bade616 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940903.019476:0:18693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08bade60f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08bade616 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940903.019482:0:18693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08bade60f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08bade616 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940903.019487:0:18693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788940903.019613:0:18693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08bade60f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade616 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940903.019621:0:18693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788940903.019672:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:303c4994-a6d4-4c7c-823f-eb7dad50725e:3646:1875839944983936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940903.019716:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940903.019796:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940903.019804:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+4:20187:x1875839944983552:12345-0@lo:104: Request processed in 1110us (3361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940903.019811:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788940903.019828:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788940903.019847:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+3:20187:x1875839944983680:12345-0@lo:104: 00010000:00010000:3.0:1788940903.019856:0:17134:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d0355e6a00/0x9c34acc08bade464 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade46b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940903.019903:0:17134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788940903.019908:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+3:20187:x1875839944983680:12345-0@lo:104: Request processed in 74us (3342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940903.019913:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788940903.019934:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940903.019940:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08bade472 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade479 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940903.020165:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e7e00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940903.020168:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08bade472 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08bade479 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940903.020174:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08bade472 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08bade479 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940903.020180:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08bade472 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08bade479 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940903.020184:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788940903.020211:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08bade60f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade616 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940903.020218:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08bade60f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade616 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940903.020240:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940903.020244:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0355e6a00/0x9c34acc08bade464 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08bade46b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940903.020250:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6a00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940903.020253:0:18693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e6a00/0x9c34acc08bade464 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08bade46b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940903.020278:0:18693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0355e6a00/0x9c34acc08bade464 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08bade46b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940903.020285:0:18693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e6a00/0x9c34acc08bade464 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08bade46b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940903.020298:0:18693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788940903.020350:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944983936 00000100:00100000:0.0:1788940903.020358:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944983936 00010000:00010000:0.0:1788940903.020381:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d004602000/0x9c34acc08bade616 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade60f expref: 23 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940903.020404:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940903.020411:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:3646:x1875839944983936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940903.020421:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940903.020426:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d004602000/0x9c34acc08bade616 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade60f expref: 23 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940903.020436:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d004602000/0x9c34acc08bade616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08bade60f expref: 23 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940903.020461:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d004602000/0x9c34acc08bade616 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08bade60f expref: 23 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940903.020474:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940903.020644:0:20187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20187:1875839944983680:0@lo:104: 00010000:00010000:2.0:1788940903.020701:0:20187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7d6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940903.020887:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:3646:x1875839944983936:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940903.020896:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940903.020934:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:303c4994-a6d4-4c7c-823f-eb7dad50725e:3646:1875839944983936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940903.021031:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940903.021174:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08bade472 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade479 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940903.021181:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940903.021200:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08bade472 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade479 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940903.021207:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0355e7e00/0x9c34acc08bade472 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade479 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940903.021218:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940903.021220:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940903.021221:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940903.021299:0:18693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0355e6a00/0x9c34acc08bade464 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade46b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940903.021307:0:18693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940903.021313:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0355e6a00/0x9c34acc08bade464 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade46b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940903.021320:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0355e6a00/0x9c34acc08bade464 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08bade46b expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940903.021336:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940903.021338:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940903.021340:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940903.021354:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:303c4994-a6d4-4c7c-823f-eb7dad50725e:3648:1875839944984192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940903.021400:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940903.021437:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940903.021443:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:303c4994-a6d4-4c7c-823f-eb7dad50725e:3648:1875839944984064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940903.021469:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940903.021605:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944984192 00000100:00100000:0.0:1788940903.021612:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944984192 00010000:00010000:0.0:1788940903.021634:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584d000/0x9c34acc08bade46b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade464 expref: 22 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940903.021725:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944984064 00000100:00100000:0.0:1788940903.021729:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944984064 00010000:00010000:0.0:1788940903.021742:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584c000/0x9c34acc08bade479 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade472 expref: 23 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940903.021757:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940903.021764:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:3648:x1875839944984192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940903.021776:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940903.021780:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584d000/0x9c34acc08bade46b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade464 expref: 23 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940903.021922:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584d000/0x9c34acc08bade46b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08bade464 expref: 23 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940903.022029:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584d000/0x9c34acc08bade46b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08bade464 expref: 23 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940903.022041:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940903.022085:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:3648:x1875839944984192:12345-0@lo:103:ldlm_bl.0 Request processed in 321us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940903.022093:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940903.022109:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940903.022116:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037739450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:3648:x1875839944984064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940903.022125:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940903.022129:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584c000/0x9c34acc08bade479 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08bade472 expref: 21 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940903.022138:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584c000/0x9c34acc08bade479 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08bade472 expref: 21 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940903.022148:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584c000/0x9c34acc08bade479 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08bade472 expref: 21 pid: 17144 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940903.022157:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940903.022177:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037739450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:3648:x1875839944984064:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940903.022183:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940903.022289:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:303c4994-a6d4-4c7c-823f-eb7dad50725e:3648:1875839944984064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940903.022301:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:303c4994-a6d4-4c7c-823f-eb7dad50725e:3648:1875839944984192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940903.024475:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940903.024610:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921813888 00000100:00100000:2.0:1788940903.024623:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921813888 00010000:00010000:2.0:1788940903.024741:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584dc00/0x9c34acc08bade766 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7650 expref: 12 pid: 17145 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940903.024792:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:2.0:1788940903.024803:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c999e41f-3797-4c65-8d35-6b866b5f4f29+12:2407:x1875839921813888:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940903.024903:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940903.024911:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584dc00/0x9c34acc08bade766 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7650 expref: 12 pid: 17145 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.024925:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584dc00/0x9c34acc08bade766 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7650 expref: 12 pid: 17145 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.025232:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584dc00/0x9c34acc08bade766 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7650 expref: 12 pid: 17145 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.025330:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7d6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.025343:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7d6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.025366:0:17135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7d6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.025375:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7d6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.025382:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7d6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.025390:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7d6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.025396:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f7800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940903.025401:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7d6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.025424:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7d6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.025446:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7d6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940903.025458:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940903.025741:0:20187:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7d6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940903.025751:0:20187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7d6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940903.025768:0:20187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7d6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940903.027085:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c999e41f-3797-4c65-8d35-6b866b5f4f29+11:2407:x1875839921813888:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 2269us (2609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940903.027100:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 14 00010000:00010000:0.0:1788940903.264712:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940903.580307:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940903.580342:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944984320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940903.580444:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940903.581314:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944984320 00000100:00100000:0.0:1788940903.581330:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944984320 00000100:00100000:0.0:1788940903.581410:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788940903.581423:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944984320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940903.581474:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788940903.581675:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944984320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 252us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940903.581684:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788940903.582120:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944984320:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1788940904.098696:0:17147:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788940904.098708:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91cf0632d000 from 13 10000000:01000000:3.0:1788940904.098715:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788940904.098786:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937400/0x9c34acc08bade7dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940904.098801:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d035937400/0x9c34acc08bade7dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940904.098815:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d035937400/0x9c34acc08bade7dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940904.098852:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07845180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944984448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788940904.098967:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940904.099030:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940904.099149:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944984448 00000100:00100000:2.0:1788940904.099160:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944984448 00000100:00100000:2.0:1788940904.099244:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788940904.099315:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:17147:x1875839944984448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940904.099332:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940904.099350:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0027f6800/0x9c34acc08bade7e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade7dd expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940904.099382:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0027f6800/0x9c34acc08bade7e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade7dd expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940904.099395:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0027f6800/0x9c34acc08bade7e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade7dd expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940904.099406:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f6800, rc 0) 00000100:00100000:2.0:1788940904.099459:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:17147:x1875839944984448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940904.099483:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788940904.099542:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07845180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944984448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940904.099561:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d035937400/0x9c34acc08bade7dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade7e4 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940904.099571:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d035937400/0x9c34acc08bade7dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade7e4 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940904.099644:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944984576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940904.099674:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940904.099698:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d030d499c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940904.099712:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944984576 00000100:00100000:2.0:1788940904.099716:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944984576 00000100:00100000:2.0:1788940904.099741:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788940904.099748:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:17147:x1875839944984576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940904.099875:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:17147:x1875839944984576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940904.099882:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788940904.099912:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944984576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940904.099952:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944984704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940904.099996:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940904.100010:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d030d499c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940904.100021:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944984704 00000100:00100000:2.0:1788940904.100025:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944984704 00000100:00100000:2.0:1788940904.100045:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788940904.100059:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:17147:x1875839944984704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940904.100139:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:17147:x1875839944984704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940904.100146:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788940904.100187:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944984704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788940904.101611:0:20215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788940904.102167:0:17147:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788940904.102196:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788940904.102210:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937400/0x9c34acc08bade7dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade7e4 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940904.102235:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d035937400/0x9c34acc08bade7dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade7e4 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940904.102248:0:17147:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788940904.102252:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91cf08456000 from 13 10000000:01000000:3.0:1788940904.102284:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788940904.102353:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035936000/0x9c34acc08bade7eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940904.102363:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d035936000/0x9c34acc08bade7eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940904.102375:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d035936000/0x9c34acc08bade7eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940904.102409:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944984832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788940904.102492:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940904.102541:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940904.102740:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944984832 00000100:00100000:2.0:1788940904.102750:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944984832 00000100:00100000:2.0:1788940904.102803:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788940904.102815:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:17147:x1875839944984832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940904.102830:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940904.102845:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade7eb expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940904.102872:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade7eb expref: 22 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940904.102883:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade7eb expref: 22 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940904.102892:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f7800, rc 0) 00000100:00100000:2.0:1788940904.103206:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:17147:x1875839944984832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 392us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940904.103213:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788940904.113104:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944984832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940904.113151:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d035936000/0x9c34acc08bade7eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade7f2 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940904.113169:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d035936000/0x9c34acc08bade7eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade7f2 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940904.113353:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d001379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944984960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940904.113440:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940904.117065:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf01723180 going to sleep for 11 seconds 00000100:00100000:3.0:1788940904.117239:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944984960 00000100:00100000:3.0:1788940904.117279:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944984960 00000100:00100000:3.0:1788940904.117391:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788940904.117406:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:17147:x1875839944984960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940904.117798:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:17147:x1875839944984960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 394us (4356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940904.117807:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788940904.117892:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d001379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944984960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940904.118038:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944985088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940904.118110:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940904.118141:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0210efb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940904.118159:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944985088 00000100:00100000:3.0:1788940904.118164:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944985088 00000100:00100000:3.0:1788940904.118192:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788940904.118199:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:17147:x1875839944985088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940904.118342:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:17147:x1875839944985088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940904.118350:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788940904.118396:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944985088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788940904.119701:0:20216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788940904.119786:0:17147:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788940904.119815:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788940904.119828:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035936000/0x9c34acc08bade7eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade7f2 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940904.119842:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d035936000/0x9c34acc08bade7eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade7f2 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940904.119855:0:17147:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788940904.119858:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d03547c000 from 13 10000000:01000000:3.0:1788940904.119862:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788940904.119902:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08bade7f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940904.119911:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08bade7f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940904.119922:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08bade7f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940904.124532:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07846a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944985216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788940904.124638:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940904.124702:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0210efb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940904.124909:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944985216 00000100:00100000:1.0:1788940904.124920:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944985216 00000100:00100000:1.0:1788940904.124997:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788940904.125009:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:17147:x1875839944985216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940904.125033:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940904.125058:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d042052a00/0x9c34acc08bade800 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade7f9 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940904.125093:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d042052a00/0x9c34acc08bade800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade7f9 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940904.125106:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d042052a00/0x9c34acc08bade800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade7f9 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940904.125116:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d042052a00, rc 0) 00000100:00100000:1.0:1788940904.125168:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:17147:x1875839944985216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940904.125176:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788940904.125242:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07846a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944985216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940904.125282:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08bade7f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade800 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940904.125292:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08bade7f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade800 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940904.125387:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d001379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944985344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940904.125432:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940904.125453:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf01723180 going to sleep for 11 seconds 00000100:00100000:1.0:1788940904.125467:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944985344 00000100:00100000:1.0:1788940904.125482:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944985344 00000100:00100000:1.0:1788940904.125508:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788940904.125514:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d36e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:17147:x1875839944985344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940904.125640:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d36e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:17147:x1875839944985344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940904.125648:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788940904.125679:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d001379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944985344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940904.125726:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d001379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944985472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940904.125763:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940904.125774:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf01723180 going to sleep for 11 seconds 00000100:00100000:1.0:1788940904.125784:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944985472 00000100:00100000:1.0:1788940904.125787:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944985472 00000100:00100000:1.0:1788940904.125807:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788940904.125812:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:17147:x1875839944985472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940904.125889:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:17147:x1875839944985472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940904.125895:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788940904.125935:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d001379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944985472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788940904.128786:0:20218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788940904.130072:0:17147:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788940904.130133:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940904.130149:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08bade7f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade800 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940904.130164:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08bade7f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade800 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940904.130179:0:17147:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788940904.130183:0:17147:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91cf08ce7800 from 13 10000000:01000000:1.0:1788940904.130186:0:17147:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940904.130284:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08bade807 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940904.130295:0:17147:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08bade807 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940904.130311:0:17147:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08bade807 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940904.130349:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d001379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944985600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788940904.130463:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940904.130522:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf01723180 going to sleep for 11 seconds 00000100:00100000:2.0:1788940904.130699:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944985600 00000100:00100000:2.0:1788940904.130708:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944985600 00000100:00100000:2.0:1788940904.130770:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788940904.130781:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:17147:x1875839944985600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940904.130799:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940904.130815:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d0027f7e00/0x9c34acc08bade80e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08bade807 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940904.130843:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d0027f7e00/0x9c34acc08bade80e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08bade807 expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940904.130856:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d0027f7e00/0x9c34acc08bade80e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08bade807 expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940904.130866:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f7e00, rc 0) 00000100:00100000:2.0:1788940904.130928:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:17147:x1875839944985600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940904.130942:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788940904.131093:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d001379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944985600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940904.131111:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08bade807 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade80e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940904.131120:0:17147:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08bade807 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade80e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940904.131194:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944985728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940904.131241:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940904.131293:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0210efb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940904.131355:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944985728 00000100:00100000:1.0:1788940904.131361:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944985728 00000100:00100000:1.0:1788940904.131401:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788940904.131408:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d36dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:17147:x1875839944985728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940904.131545:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d36dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:17147:x1875839944985728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940904.131552:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788940904.131583:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944985728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940904.131625:0:17147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944985856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940904.131672:0:17147:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940904.131691:0:17147:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf01723180 going to sleep for 11 seconds 00000100:00100000:1.0:1788940904.131702:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944985856 00000100:00100000:1.0:1788940904.131705:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944985856 00000100:00100000:1.0:1788940904.131721:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788940904.131728:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d36d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:17147:x1875839944985856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940904.131815:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d36d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:17147:x1875839944985856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940904.131822:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788940904.131863:0:17147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:303c4994-a6d4-4c7c-823f-eb7dad50725e:17147:1875839944985856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788940904.136841:0:20219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788940904.137905:0:17147:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788940904.138015:0:17147:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940904.138034:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08bade807 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade80e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940904.138051:0:17147:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08bade807 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade80e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940904.284584:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940904.683191:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940904.683394:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921814016 00000100:00100000:0.0:1788940904.683410:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921814016 00000100:00100000:0.0:1788940904.683620:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 160 00000100:00100000:0.0:1788940904.683633:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d36e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+11:14978:x1875839921814016:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940904.683657:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940904.683682:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584c200/0x9c34acc08bade815 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc76f8 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940904.683723:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584c200/0x9c34acc08bade815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76f8 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940904.683738:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584c200/0x9c34acc08bade815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76f8 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940904.683752:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c200, rc 0) 00000100:00100000:0.0:1788940904.683841:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d36e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+12:14978:x1875839921814016:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 Request processed in 211us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940904.683850:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 160 00000100:00100000:3.0:1788940904.688365:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940904.688420:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921814144 00000100:00100000:3.0:1788940904.688435:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921814144 00000100:00100000:3.0:1788940904.688506:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 161 00000100:00100000:3.0:1788940904.688518:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00ddca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+12:14978:x1875839921814144:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940904.688728:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00ddca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+12:14978:x1875839921814144:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 Request processed in 211us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940904.688738:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 161 00000100:00100000:0.0:1788940904.698677:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940904.698788:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921814272 00000100:00100000:2.0:1788940904.698804:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921814272 00000100:00100000:2.0:1788940904.698893:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 162 00000100:00100000:2.0:1788940904.698908:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+12:14978:x1875839921814272:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940904.699103:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+12:14978:x1875839921814272:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 Request processed in 199us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940904.699112:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 162 00000100:00100000:3.0:1788940904.710663:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940904.710721:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921814400 00000100:00100000:3.0:1788940904.710736:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921814400 00000100:00100000:3.0:1788940904.710820:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 163 00000100:00100000:3.0:1788940904.710834:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+12:14978:x1875839921814400:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940904.710861:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940904.710893:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d035936e00/0x9c34acc08bade81c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc76ff expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940904.710955:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d035936e00/0x9c34acc08bade81c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76ff expref: 13 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940904.710969:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d035936e00/0x9c34acc08bade81c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76ff expref: 13 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940904.710979:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936e00, rc 0) 00000100:00100000:3.0:1788940904.711060:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:14978:x1875839921814400:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 Request processed in 228us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940904.711067:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 163 00000100:00100000:3.0:1788940904.718710:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940904.718793:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921814528 00000100:00100000:0.0:1788940904.718807:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921814528 00000100:00100000:0.0:1788940904.718881:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 164 00000100:00100000:0.0:1788940904.718893:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:14978:x1875839921814528:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940904.719093:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:14978:x1875839921814528:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 Request processed in 201us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940904.719102:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 164 00000100:00100000:3.0:1788940904.732426:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940904.732480:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921814656 00000100:00100000:3.0:1788940904.732496:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921814656 00000100:00100000:3.0:1788940904.732581:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 165 00000100:00100000:3.0:1788940904.732594:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:14978:x1875839921814656:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940904.732790:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:14978:x1875839921814656:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 Request processed in 198us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940904.732799:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 165 00010000:00010000:1.0:1788940905.332985:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940905.628416:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940905.628444:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944985984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940905.628546:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940905.628602:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944985984 00000100:00100000:0.0:1788940905.628611:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944985984 00000100:00100000:0.0:1788940905.628668:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788940905.628678:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944985984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788940905.628725:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788940905.628781:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944985984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940905.628789:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788940905.628848:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944985984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940905.630390:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944986112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940905.630455:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940905.630503:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940905.630509:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944986240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788940905.630536:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940905.630582:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944986240 00000100:00100000:0.0:1788940905.630591:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944986240 00000100:00100000:0.0:1788940905.630645:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788940905.630653:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944986240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788940905.630691:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788940905.630736:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944986240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940905.630743:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788940905.630791:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944986240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788940905.630865:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944986112 00000100:00100000:3.0:1788940905.630871:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944986112 00000100:00100000:3.0:1788940905.630925:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788940905.630933:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944986112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788940905.630958:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788940905.630997:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944986112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940905.631010:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788940905.631163:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940905.631190:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944986112:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788940905.761426:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788940905.781800:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940905.781851:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940905.781883:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940905.781909:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921814784 00000100:00100000:1.0:1788940905.781915:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940905.781923:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921814784 00000100:00100000:3.0:1788940905.781997:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 166 00000100:00100000:3.0:1788940905.782010:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:2404:x1875839921814784:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940905.782104:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:2404:x1875839921814784:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 98us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940905.782112:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 166 00000100:00100000:1.0:1788940905.783135:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940905.783159:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940905.783197:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940905.783231:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940905.783268:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940905.783271:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921815168 00000100:00100000:3.0:1788940905.783282:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921815168 00000100:00100000:1.0:1788940905.783294:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921814912 00000100:00100000:1.0:1788940905.783298:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921814912 00000100:00100000:1.0:1788940905.783329:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921815040 00000100:00100000:3.0:1788940905.783330:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921815296 00000100:00100000:3.0:1788940905.783332:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921815296 00000100:00100000:1.0:1788940905.783333:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921815040 00000100:00100000:3.0:1788940905.783346:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921815680 00000100:00100000:1.0:1788940905.783346:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921815424 00000100:00100000:3.0:1788940905.783348:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921815680 00000100:00100000:1.0:1788940905.783348:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921815424 00000100:00100000:3.0:1788940905.783358:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921815808 00000100:00100000:1.0:1788940905.783358:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921815552 00000100:00100000:1.0:1788940905.783360:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921815552 00000100:00100000:3.0:1788940905.783361:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921815808 00000100:00100000:3.0:1788940905.783377:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:1.0:1788940905.783377:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:3.0:1788940905.783385:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03914f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2405:x1875839921815168:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940905.783385:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:2405:x1875839921814912:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940905.783447:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03914f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2405:x1875839921815168:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 62us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940905.783454:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:0.0:1788940905.783573:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:0.0:1788940905.783583:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2404:x1875839921815040:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940905.783620:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:3.0:1788940905.783636:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2404:x1875839921815296:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940905.784031:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:2405:x1875839921814912:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 643us (2175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940905.784040:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:3.0:1788940905.784171:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2404:x1875839921815296:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 533us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940905.784178:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:3.0:1788940905.784215:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:3.0:1788940905.784223:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2405:x1875839921815680:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940905.784252:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2405:x1875839921815680:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 31us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940905.784276:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:3.0:1788940905.784288:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:3.0:1788940905.784295:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2404:x1875839921815808:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940905.784319:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2404:x1875839921815808:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 26us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940905.784325:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:1.0:1788940905.784462:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:1.0:1788940905.784476:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2405:x1875839921815424:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940905.784507:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2405:x1875839921815424:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 34us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940905.784514:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:1.0:1788940905.784527:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:1.0:1788940905.784534:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2404:x1875839921815552:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940905.784560:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2404:x1875839921815552:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 26us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940905.784567:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:0.0:1788940905.788864:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2404:x1875839921815040:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 5260us (6956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940905.788885:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00080000:0.0:1788940905.789677:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940905.789686:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788940905.789695:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940905.789698:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788940906.396118:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940907.093650:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940907.093904:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921815936 00000100:00100000:3.0:1788940907.093925:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921815936 00000100:00100000:3.0:1788940907.094000:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:3.0:1788940907.094011:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:15646:x1875839921815936:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940907.094032:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940907.094056:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08bade823 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7706 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.094144:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08bade82a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.094160:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08bade82a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.094174:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08bade82a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.094486:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08bade831 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.094495:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08bade831 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.094503:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08bade831 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.094588:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08bade838 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.094663:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08bade838 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.094671:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08bade838 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940907.094715:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788940907.094720:0:17150:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940907.094962:0:17150:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08bade838 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.094977:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08bade82a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.094984:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08bade82a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.094992:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08bade82a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.095009:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940907.095014:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08bade82a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.095022:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08bade82a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.095036:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfe300) 00010000:00010000:3.0:1788940907.095039:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940907.095046:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08bade82a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.095053:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08bade82a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.095069:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08bade831 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.095075:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08bade831 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.095081:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08bade831 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.095086:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940907.095089:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08bade831 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.095095:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08bade831 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.095112:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91d0207af100) 00010000:00010000:3.0:1788940907.095115:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940907.095118:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08bade831 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.095124:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08bade831 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.095161:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08bade823 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7706 expref: 8 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.095174:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08bade838 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7706 expref: 7 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.095182:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91d0207afa00) 00010000:00010000:3.0:1788940907.095185:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940907.095562:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936600, rc 0) 00000100:00100000:3.0:1788940907.095649:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+7:15646:x1875839921815936:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1639us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940907.095658:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00080000:0.0:1788940907.095909:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940907.099079:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940907.099362:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921816064 00000100:00100000:3.0:1788940907.099372:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921816064 00000100:00100000:3.0:1788940907.099430:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:3.0:1788940907.099440:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+7:15646:x1875839921816064:12345-192.168.202.25@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788940907.099530:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+7:15646:x1875839921816064:12345-192.168.202.25@tcp:900:lhsmtool_posix.0 Request processed in 91us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940907.099537:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:1.0:1788940907.103564:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940907.103693:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921816320 00000100:00100000:3.0:1788940907.103703:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921816320 00000100:00100000:3.0:1788940907.103768:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:3.0:1788940907.103778:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+7:15646:x1875839921816320:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940907.103799:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940907.103818:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade83f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc770d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.103888:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade846 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.103902:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade846 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.103925:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade846 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.103975:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade84d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.103982:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade84d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.103989:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade84d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.104095:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08bade854 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.104103:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08bade854 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.104128:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08bade854 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940907.104139:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788940907.104319:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade846 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.104328:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade846 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.104334:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade846 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.104340:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940907.104344:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade846 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.104352:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade846 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.104364:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91d0207afa00) 00010000:00010000:3.0:1788940907.104367:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940907.104372:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade846 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.104378:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade846 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.104391:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade84d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.104398:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade84d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.104409:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade84d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.104414:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940907.104416:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade84d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.104422:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade84d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.104429:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91d0207afb00) 00010000:00010000:3.0:1788940907.104432:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940907.104435:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade84d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.104440:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade84d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.105357:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade83f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc770d expref: 10 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.105377:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08bade854 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc770d expref: 9 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.105386:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d0207afe00) 00010000:00010000:3.0:1788940907.105389:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940907.105392:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937200, rc 0) 00000100:00100000:3.0:1788940907.105466:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+9:15646:x1875839921816320:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1688us (1909us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788940907.105484:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:1.0:1788940907.121166:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940907.121521:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921816448 00000100:00100000:2.0:1788940907.121533:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921816448 00000100:00100000:2.0:1788940907.121846:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:2.0:1788940907.121874:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+9:15646:x1875839921816448:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788940907.124324:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+9:15646:x1875839921816448:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 Request processed in 2442us (3161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940907.126232:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:1.0:1788940907.138032:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940907.138136:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921816576 00000100:00100000:0.0:1788940907.138148:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921816576 00000100:00100000:0.0:1788940907.138252:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:0.0:1788940907.138306:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:15646:x1875839921816576:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1788940907.141233:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1788940907.148312:0:18958:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 9955us 00000100:00100000:1.0:1788940907.184170:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:15646:x1875839921816576:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 Request processed in 45855us (46137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940907.184205:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:1.0:1788940907.198467:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940907.198551:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921816704 00000100:00100000:3.0:1788940907.198562:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921816704 00000100:00100000:3.0:1788940907.198622:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:3.0:1788940907.198634:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+9:15652:x1875839921816704:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940907.198659:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940907.198681:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade862 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7714 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.198761:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade869 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.198777:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade869 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.198790:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade869 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.198806:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade870 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.198812:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.198819:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.198868:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade869 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.198889:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade869 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.198896:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade869 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.198902:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940907.198921:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade869 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.198931:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade869 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.198944:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfe300) 00010000:00010000:3.0:1788940907.198947:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940907.198952:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade869 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.198958:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.198969:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.198975:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade870 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.198979:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade870 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.198984:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940907.198992:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade870 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.199000:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade870 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.199008:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91d0207afb00) 00010000:00010000:3.0:1788940907.199011:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940907.199014:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade870 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.199019:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade870 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.199053:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade862 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7714 expref: 10 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.199064:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfe300) 00010000:00010000:3.0:1788940907.199066:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940907.199069:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade862 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7714 expref: 10 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.199078:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937c00, rc 0) 00000100:00100000:3.0:1788940907.199143:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+9:15652:x1875839921816704:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 511us (689us total) trans 0 rc 301/301 00000100:00100000:3.0:1788940907.199150:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:1.0:1788940907.205874:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940907.206052:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921816832 00000100:00100000:0.0:1788940907.206062:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921816832 00000100:00100000:0.0:1788940907.206135:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:0.0:1788940907.206146:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+9:15652:x1875839921816832:12345-192.168.202.25@tcp:700:lfs.0 00000100:00100000:0.0:1788940907.206253:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+9:15652:x1875839921816832:12345-192.168.202.25@tcp:700:lfs.0 Request processed in 108us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940907.206292:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:1.0:1788940907.214404:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940907.214484:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921817088 00000100:00100000:3.0:1788940907.214496:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921817088 00000100:00100000:3.0:1788940907.214653:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:3.0:1788940907.214664:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+9:15652:x1875839921817088:12345-192.168.202.25@tcp:36:lfs.0 00010000:00010000:3.0:1788940907.214742:0:17151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940907.214783:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08bade790 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7681 expref: 9 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.214802:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfe300) 00010000:00010000:3.0:1788940907.214808:0:17151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940907.214871:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade877 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.214886:0:17151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053600/0x9c34acc08bade7cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76f1 expref: 5 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.214895:0:17151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade877 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.214945:0:17151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053600/0x9c34acc08bade7cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76f1 expref: 5 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.214960:0:17151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053600/0x9c34acc08bade7cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76f1 expref: 5 pid: 18958 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940907.214974:0:17151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07844000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17151:1875839944986368:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788940907.215063:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0029a0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788940907.219745:0:17151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07844000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17151:1875839944986368:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788940907.219777:0:17151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade877 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940907.221394:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940907.221489:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921817216 00000100:00100000:0.0:1788940907.221500:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921817216 00010000:00010000:0.0:1788940907.221568:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053600/0x9c34acc08bade7cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76f1 expref: 6 pid: 18958 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788940907.221574:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940907.221607:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:0.0:1788940907.221617:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2405:x1875839921817216:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940907.221632:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940907.221639:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053600/0x9c34acc08bade7cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76f1 expref: 6 pid: 18958 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940907.221652:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053600/0x9c34acc08bade7cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76f1 expref: 6 pid: 18958 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940907.221675:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053600/0x9c34acc08bade7cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76f1 expref: 6 pid: 18958 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940907.221693:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfe300) 00010000:00010000:0.0:1788940907.221699:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade877 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940907.221709:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade877 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940907.221729:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade877 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940907.221762:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940907.221825:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2405:x1875839921817216:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 208us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940907.221833:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 15 00010000:00010000:1.0:1788940907.222158:0:17151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade877 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.222168:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade877 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.222216:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053c00/0x9c34acc08bade87e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.222227:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053c00/0x9c34acc08bade87e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.222234:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053c00/0x9c34acc08bade87e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.228735:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053000/0x9c34acc08bade885 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.228772:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053000/0x9c34acc08bade885 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.228797:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053000/0x9c34acc08bade885 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940907.228818:0:17151:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000795064d reply state 0000000019bb3b4c transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053000/0x9c34acc08bade885 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.228829:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053000/0x9c34acc08bade885 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.228836:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91cf06dfcd00) 00010000:00010000:1.0:1788940907.228839:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788940907.228843:0:17151:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788940907.228850:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788940907.228858:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade877 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.228865:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade877 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.228873:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade877 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.228879:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940907.228884:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade877 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.228891:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade877 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.228901:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfe300) 00010000:00010000:1.0:1788940907.228904:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940907.228915:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade877 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.228921:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937c00/0x9c34acc08bade877 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940907.228941:0:17151:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000795064d reply state 0000000019bb3b4c transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053c00/0x9c34acc08bade87e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.228950:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053c00/0x9c34acc08bade87e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.228957:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91cf06dfc400) 00010000:00010000:1.0:1788940907.228959:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788940907.228961:0:17151:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788940907.229083:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+10:15652:x1875839921817088:12345-192.168.202.25@tcp:36:lfs.0 Request processed in 14416us (14686us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788940907.229093:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:1.0:1788940907.371623:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940907.371790:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921817344 00000100:00100000:2.0:1788940907.371802:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921817344 00000100:00100000:2.0:1788940907.371872:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:2.0:1788940907.371884:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+10:15660:x1875839921817344:12345-192.168.202.25@tcp:101:lctl.0 00010000:00010000:2.0:1788940907.371909:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940907.371937:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08bade88c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc771b expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.372009:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08bade893 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.372024:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08bade893 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.372223:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08bade893 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940907.372330:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788940907.372334:0:17152:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788940907.372376:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08bade893 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.372403:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08bade88c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc771b expref: 12 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.372440:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08bade893 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc771b expref: 11 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.372449:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d00293a800) 00010000:00010000:2.0:1788940907.372452:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940907.372456:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f7600, rc 0) 00000100:00100000:2.0:1788940907.372590:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+11:15660:x1875839921817344:12345-192.168.202.25@tcp:101:lctl.0 Request processed in 708us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940907.372598:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:3.0:1788940907.414158:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940907.414282:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921817472 00000100:00100000:1.0:1788940907.414293:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921817472 00000100:00100000:1.0:1788940907.414355:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:1.0:1788940907.414363:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:15661:x1875839921817472:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788940907.414387:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940907.414408:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052c00/0x9c34acc08bade89a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7722 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.414468:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053600/0x9c34acc08bade8a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.414479:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053600/0x9c34acc08bade8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.414494:0:18958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053600/0x9c34acc08bade8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940907.414543:0:18958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788940907.414545:0:18958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788940907.414561:0:18958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053600/0x9c34acc08bade8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.414579:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052c00/0x9c34acc08bade89a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7722 expref: 7 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.414595:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053600/0x9c34acc08bade8a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7722 expref: 6 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.414603:0:18958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d00293a800) 00010000:00010000:1.0:1788940907.414606:0:18958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940907.414610:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d042053600, rc 0) 00000100:00100000:1.0:1788940907.414674:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:15661:x1875839921817472:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 311us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940907.414679:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:1.0:1788940907.417745:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940907.417842:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921817600 00000100:00100000:3.0:1788940907.417852:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921817600 00000100:00100000:3.0:1788940907.417903:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:3.0:1788940907.417913:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:15661:x1875839921817600:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940907.417937:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940907.417958:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade8a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7729 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418031:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418051:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418061:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418069:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08bade8b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418073:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08bade8b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418077:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08bade8b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418290:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08bade8bd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418300:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08bade8bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418327:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08bade8bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940907.418366:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788940907.418370:0:17150:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940907.418390:0:17150:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08bade8bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418401:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418408:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418414:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418420:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940907.418425:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418432:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418443:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d00293a800) 00010000:00010000:3.0:1788940907.418446:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940907.418451:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418457:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418480:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08bade8b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418486:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08bade8b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418492:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08bade8b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418497:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940907.418500:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08bade8b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418506:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08bade8b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418513:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91cf06dfc400) 00010000:00010000:3.0:1788940907.418515:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940907.418518:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08bade8b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418524:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08bade8b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418550:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade8a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7729 expref: 8 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418564:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08bade8bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7729 expref: 7 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.418583:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91cf06dfcd00) 00010000:00010000:3.0:1788940907.418597:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940907.418600:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936200, rc 0) 00000100:00100000:3.0:1788940907.418658:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+7:15661:x1875839921817600:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 745us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940907.418665:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 31 00010000:00010000:2.0:1788940907.423924:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940907.428755:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940907.428860:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921817728 00000100:00100000:3.0:1788940907.428871:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921817728 00000100:00080000:2.0:1788940907.429003:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788940907.429056:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:3.0:1788940907.429068:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:15661:x1875839921817728:12345-192.168.202.25@tcp:900:lfs.0 00000100:00100000:3.0:1788940907.429171:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:15661:x1875839921817728:12345-192.168.202.25@tcp:900:lfs.0 Request processed in 106us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940907.429179:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:1.0:1788940907.434808:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940907.435013:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921817984 00000100:00100000:3.0:1788940907.435028:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921817984 00000100:00100000:3.0:1788940907.435105:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 32 00000100:00100000:3.0:1788940907.435117:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+7:15661:x1875839921817984:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940907.435139:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940907.435160:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade8c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7730 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940907.435685:0:18958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788940907.435818:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade8c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7730 expref: 9 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.435833:0:18958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d00293a800) 00010000:00010000:2.0:1788940907.435836:0:18958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940907.435843:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937a00/0x9c34acc08bade8c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7730 expref: 9 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.435858:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937a00, rc 0) 00000100:00100000:2.0:1788940907.435928:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+8:15661:x1875839921817984:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 814us (1132us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788940907.435937:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 32 00000100:00100000:2.0:1788940907.440946:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940907.441180:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921818240 00000100:00100000:1.0:1788940907.441201:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921818240 00000100:00100000:1.0:1788940907.441471:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:1.0:1788940907.441483:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+8:15661:x1875839921818240:12345-192.168.202.25@tcp:36:lfs.0 00010000:00010000:1.0:1788940907.441616:0:17152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940907.441653:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936200/0x9c34acc08bade8bd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7729 expref: 8 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.441673:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91cf06dfcd00) 00010000:00010000:1.0:1788940907.441679:0:17152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940907.441701:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052c00/0x9c34acc08bade8d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.441715:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052c00/0x9c34acc08bade8d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.441726:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052c00/0x9c34acc08bade8d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940907.441938:0:17152:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007858ea6 reply state 00000000f68a112a transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052c00/0x9c34acc08bade8d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.441952:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052c00/0x9c34acc08bade8d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.441958:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91cf06dfcd00) 00010000:00010000:1.0:1788940907.441961:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788940907.442207:0:17152:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788940907.442217:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788940907.442435:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+9:15661:x1875839921818240:12345-192.168.202.25@tcp:36:lfs.0 Request processed in 952us (1498us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788940907.442443:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:0.0:1788940907.456701:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940907.456798:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921818496 00000100:00100000:3.0:1788940907.456809:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921818496 00000100:00100000:3.0:1788940907.456915:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:3.0:1788940907.456925:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+9:15661:x1875839921818496:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:3.0:1788940907.457450:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+10:15661:x1875839921818496:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 524us (758us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788940907.457459:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:1.0:1788940907.466871:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940907.467052:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921818752 00000100:00100000:2.0:1788940907.467065:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921818752 00000100:00100000:2.0:1788940907.467139:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00100000:2.0:1788940907.467149:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+10:15661:x1875839921818752:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1788940907.467178:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940907.467231:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08bade8d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7737 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467341:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade8e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467358:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade8e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467370:0:18958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade8e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467381:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08bade8e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467387:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08bade8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467393:0:18958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08bade8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940907.467514:0:18958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788940907.467623:0:18958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade8e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467630:0:18958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade8e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467649:0:18958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade8e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467655:0:18958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940907.467660:0:18958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade8e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467668:0:18958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade8e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467679:0:18958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d00293a800) 00010000:00010000:2.0:1788940907.467682:0:18958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940907.467687:0:18958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade8e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467694:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade8e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467710:0:18958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08bade8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467716:0:18958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08bade8e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467722:0:18958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08bade8e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467726:0:18958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f7400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940907.467729:0:18958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08bade8e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467743:0:18958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08bade8e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467751:0:18958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91cf06dfc400) 00010000:00010000:2.0:1788940907.467753:0:18958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940907.467757:0:18958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08bade8e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467762:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08bade8e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467799:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08bade8d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7737 expref: 12 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467809:0:18958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d00293a800) 00010000:00010000:2.0:1788940907.467812:0:18958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940907.467816:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08bade8d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7737 expref: 12 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.467826:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f6600, rc 0) 00000100:00100000:2.0:1788940907.467885:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+11:15661:x1875839921818752:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 737us (1028us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788940907.467893:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00100000:2.0:1788940907.474550:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940907.474687:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921818880 00000100:00100000:3.0:1788940907.474699:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921818880 00000100:00100000:3.0:1788940907.474761:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 35 00000100:00100000:3.0:1788940907.474773:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+11:15661:x1875839921818880:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:3.0:1788940907.474798:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940907.474819:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08bade8f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc773e expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.474919:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.474935:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.474949:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940907.474990:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788940907.474994:0:17150:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788940907.475017:0:17150:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.475045:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08bade8f5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc773e expref: 13 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.475065:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc773e expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.475089:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91cf06dfcd00) 00010000:00010000:3.0:1788940907.475092:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940907.475095:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937800, rc 0) 00000100:00100000:3.0:1788940907.475617:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+12:15661:x1875839921818880:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 844us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940907.475625:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 35 00000040:00080000:0.0:1788940907.485620:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788940907.490191:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940907.495619:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921819008 00000100:00100000:1.0:1788940907.495637:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921819008 00000100:00100000:0.0:1788940907.499933:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:0.0:1788940907.499949:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+12:15661:x1875839921819008:12345-192.168.202.25@tcp:37:lfs.0 00000100:00100000:3.0:1788940907.507841:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+12:15661:x1875839921819008:12345-192.168.202.25@tcp:37:lfs.0 Request processed in 7883us (17658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940907.507856:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:2.0:1788940907.523477:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940907.524653:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921819264 00000100:00100000:3.0:1788940907.524668:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921819264 00000100:00100000:3.0:1788940907.524739:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:3.0:1788940907.524881:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034724050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+12:15661:x1875839921819264:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:3.0:1788940907.525158:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034724050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+13:15661:x1875839921819264:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 282us (1690us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788940907.530986:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:0.0:1788940907.656781:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940907.657000:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921819392 00000100:00100000:2.0:1788940907.657011:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921819392 00000100:00100000:2.0:1788940907.657076:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:2.0:1788940907.657101:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+11:15667:x1875839921819392:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1788940907.657123:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940907.657143:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08bade903 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7745 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.657414:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade90a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.657430:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade90a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.657442:0:18958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade90a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.657455:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08bade911 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.657462:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08bade911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.657468:0:18958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08bade911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.657678:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08bade918 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.657688:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08bade918 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.657696:0:18958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08bade918 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940907.657861:0:18958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788940907.657866:0:18958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788940907.657912:0:18958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08bade918 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.657924:0:18958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade90a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.657931:0:18958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade90a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.657939:0:18958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade90a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.657946:0:18958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940907.657950:0:18958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade90a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.657958:0:18958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade90a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.658012:0:18958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d00293a800) 00010000:00010000:2.0:1788940907.658015:0:18958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940907.658020:0:18958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade90a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.658027:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08bade90a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.658040:0:18958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08bade911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.658056:0:18958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08bade911 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.658062:0:18958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08bade911 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.658067:0:18958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940907.658070:0:18958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08bade911 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.658075:0:18958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08bade911 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.658082:0:18958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91cf06dfc400) 00010000:00010000:2.0:1788940907.658084:0:18958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940907.658087:0:18958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08bade911 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.658092:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08bade911 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.658120:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08bade903 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7745 expref: 13 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.658134:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08bade918 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7745 expref: 12 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.658142:0:18958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91cf06dfcd00) 00010000:00010000:2.0:1788940907.658144:0:18958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788940907.658153:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602000, rc 0) 00000100:00100000:2.0:1788940907.658454:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+12:15667:x1875839921819392:12345-192.168.202.25@tcp:101:bash.0 Request processed in 1353us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940907.658464:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:0.0:1788940907.662863:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940907.663621:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921819520 00000100:00100000:3.0:1788940907.663634:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921819520 00000100:00100000:3.0:1788940907.663710:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:3.0:1788940907.663721:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:15667:x1875839921819520:12345-192.168.202.25@tcp:900:bash.0 00000100:00100000:3.0:1788940907.663870:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:15667:x1875839921819520:12345-192.168.202.25@tcp:900:bash.0 Request processed in 151us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940907.663879:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:2.0:1788940907.674799:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940907.675496:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944986496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788940907.675587:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940907.675643:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944986496 00000100:00100000:1.0:1788940907.675651:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944986496 00000100:00100000:1.0:1788940907.675702:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788940907.675712:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944986496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788940907.675754:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788940907.675800:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944986496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940907.675807:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788940907.675833:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940907.675885:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944986496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940907.676384:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944986752:0@lo:400:kworker.0 00000100:00100000:0.0:1788940907.676424:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940907.676453:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944987264:0@lo:400:kworker.0 00000100:00100000:0.0:1788940907.676476:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940907.676492:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944987776:0@lo:400:kworker.0 00000100:00100000:0.0:1788940907.676512:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940907.676543:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788940907.676549:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944986880:0@lo:400:kworker.0 00000100:00100000:0.0:1788940907.676573:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940907.676591:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944987392:0@lo:400:kworker.0 00000100:00100000:0.0:1788940907.676610:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940907.676638:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944987904:0@lo:400:kworker.0 00000100:00100000:0.0:1788940907.676659:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940907.676688:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944986752 00000100:00100000:0.0:1788940907.676693:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944986752 00000100:00100000:0.0:1788940907.676724:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788940907.676731:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3647:x1875839944986752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940907.676781:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3647:x1875839944986752:12345-0@lo:400:kworker.0 Request processed in 50us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940907.676788:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788940907.676820:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944986880 00000100:00100000:0.0:1788940907.676823:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944986880 00000100:00100000:0.0:1788940907.676844:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944987392 00000100:00100000:0.0:1788940907.676846:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944987392 00000100:00100000:0.0:1788940907.676861:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788940907.676867:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944986880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940907.676901:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944986880:12345-0@lo:400:kworker.0 Request processed in 34us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940907.676907:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788940907.676918:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788940907.676923:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944987392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940907.676949:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944987392:12345-0@lo:400:kworker.0 Request processed in 26us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940907.676955:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788940907.676990:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944986880:0@lo:400:kworker.0 00000100:00100000:0.0:1788940907.677000:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944987392:0@lo:400:kworker.0 00000100:00100000:0.0:1788940907.677009:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944986752:0@lo:400:kworker.0 00000100:00100000:2.0:1788940907.677327:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921819776 00000100:00100000:2.0:1788940907.677334:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921819776 00000100:00100000:2.0:1788940907.677360:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944987264 00000100:00100000:2.0:1788940907.677363:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944987264 00000100:00100000:2.0:1788940907.677377:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944987776 00000100:00100000:2.0:1788940907.677380:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944987776 00000100:00100000:2.0:1788940907.677400:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944987904 00000100:00100000:2.0:1788940907.677403:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944987904 00000100:00100000:2.0:1788940907.677419:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788940907.677425:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944987264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940907.677468:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944987264:12345-0@lo:400:kworker.0 Request processed in 43us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940907.677474:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788940907.677489:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788940907.677495:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944987776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940907.677538:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944987776:12345-0@lo:400:kworker.0 Request processed in 43us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940907.677545:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788940907.677557:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788940907.677563:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944987904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940907.677590:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944987904:12345-0@lo:400:kworker.0 Request processed in 27us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940907.677596:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788940907.677622:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 37 00000100:00100000:2.0:1788940907.677628:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+12:15667:x1875839921819776:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1788940907.677641:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940907.677663:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08bade91f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc774c expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.677809:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08bade926 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.677826:0:18958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8fc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc773e expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.677836:0:18958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08bade926 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.677867:0:18958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc773e expref: 12 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.677880:0:18958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8fc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc773e expref: 12 pid: 17150 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940907.677893:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18958:1875839944988288:192.168.202.25@tcp:104: 00000100:00100000:2.0:1788940907.677956:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d035a3c000 going to sleep for 11 seconds 00000100:00080000:0.0:1788940907.678219:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788940907.678224:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788940907.678253:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08c0c000 x1875839944987904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940907.678293:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944987904:0@lo:400:kworker.0 00000100:00100000:0.0:1788940907.678307:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944987264:0@lo:400:kworker.0 00000100:00100000:0.0:1788940907.678318:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944987776:0@lo:400:kworker.0 00000100:00100000:1.0:1788940907.678799:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf086c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944986624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940907.678848:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940907.678877:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944987136:0@lo:400:kworker.0 00000100:00100000:1.0:1788940907.678902:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940907.678921:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944987648:0@lo:400:kworker.0 00000100:00100000:1.0:1788940907.678944:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940907.678957:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944988160:0@lo:400:kworker.0 00000100:00100000:1.0:1788940907.678977:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940907.678993:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788940907.679000:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944987008:0@lo:400:kworker.0 00000100:00100000:1.0:1788940907.679022:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940907.679041:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944987520:0@lo:400:kworker.0 00000100:00100000:1.0:1788940907.679062:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940907.679080:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944988032:0@lo:400:kworker.0 00000100:00100000:1.0:1788940907.679116:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940907.679140:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944987136 00000100:00100000:1.0:1788940907.679147:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944987136 00000100:00100000:1.0:1788940907.679210:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944987008 00000100:00100000:1.0:1788940907.679213:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944987008 00000100:00100000:1.0:1788940907.679231:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944987520 00000100:00100000:1.0:1788940907.679234:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944987520 00000100:00100000:1.0:1788940907.679248:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788940907.679272:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944987136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940907.679318:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944987136:12345-0@lo:400:kworker.0 Request processed in 63us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940907.679326:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788940907.679342:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788940907.679349:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944987008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940907.679377:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944987008:12345-0@lo:400:kworker.0 Request processed in 28us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940907.679383:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788940907.679395:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788940907.679401:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944987520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940907.679429:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944987520:12345-0@lo:400:kworker.0 Request processed in 28us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940907.679435:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788940907.679460:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944986624 00000100:00100000:1.0:1788940907.679464:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944986624 00000100:00100000:1.0:1788940907.679487:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788940907.679493:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944986624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940907.679508:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788940907.679655:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944987648 00000100:00100000:2.0:1788940907.679659:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944987648 00000100:00100000:2.0:1788940907.679680:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944988160 00000100:00100000:2.0:1788940907.679683:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944988160 00000100:00100000:2.0:1788940907.679696:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944988032 00000100:00100000:2.0:1788940907.679699:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944988032 00000100:00100000:2.0:1788940907.679725:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788940907.679732:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944987648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940907.679769:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944987648:12345-0@lo:400:kworker.0 Request processed in 38us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940907.679775:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788940907.679789:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788940907.679795:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944988160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940907.679822:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944988160:12345-0@lo:400:kworker.0 Request processed in 27us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940907.679829:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788940907.679841:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788940907.679847:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944988032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940907.679873:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944988032:12345-0@lo:400:kworker.0 Request processed in 26us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940907.679879:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788940907.679980:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944987008:0@lo:400:kworker.0 00000100:00100000:2.0:1788940907.679993:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944987520:0@lo:400:kworker.0 00000100:00100000:2.0:1788940907.680003:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944988032:0@lo:400:kworker.0 00000100:00100000:2.0:1788940907.680013:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944987136:0@lo:400:kworker.0 00000100:00100000:2.0:1788940907.680023:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944987648:0@lo:400:kworker.0 00010000:00080000:2.0:1788940907.680035:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf07ff1f80 x1875839944988160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940907.680046:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944988160:0@lo:400:kworker.0 00000100:00080000:2.0:1788940907.680088:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940907.680092:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940907.680095:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940907.680097:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940907.682284:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944986624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2762us (3407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940907.682299:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788940907.683989:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944986624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940907.690814:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940907.690949:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf086c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18958:1875839944988288:192.168.202.25@tcp:104: 00010000:00010000:0.0:1788940907.690990:0:18958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08bade926 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940907.691712:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921819904 00000100:00100000:3.0:1788940907.691735:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921819904 00010000:00010000:3.0:1788940907.691776:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8fc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc773e expref: 13 pid: 17150 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940907.691820:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:3.0:1788940907.691830:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+13:2404:x1875839921819904:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940907.691846:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940907.691853:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8fc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc773e expref: 13 pid: 17150 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.691867:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc773e expref: 13 pid: 17150 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.691892:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08bade8fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc773e expref: 13 pid: 17150 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.691909:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91cf06dfcd00) 00010000:00010000:3.0:1788940907.691915:0:17135:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08bade926 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.691925:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08bade926 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.691934:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08bade926 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940907.691975:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940907.692049:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+12:2404:x1875839921819904:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 220us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940907.692066:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 16 00010000:00010000:2.0:1788940907.692770:0:18958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08bade926 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.692780:0:18958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08bade926 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.692806:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08bade92d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.692818:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08bade92d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.692829:0:18958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08bade92d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.695785:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0600/0x9c34acc08bade934 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.695811:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0600/0x9c34acc08bade934 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.695823:0:18958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0600/0x9c34acc08bade934 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940907.695837:0:18958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788940907.695867:0:18958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08bade926 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.695894:0:18958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08bade926 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.695900:0:18958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08bade926 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.695907:0:18958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940907.695911:0:18958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08bade926 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.695919:0:18958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08bade926 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.695931:0:18958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91cf06dfcd00) 00010000:00010000:2.0:1788940907.695933:0:18958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940907.695938:0:18958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08bade926 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.695944:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08bade926 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940907.695958:0:18958:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2afafcd reply state 000000001bffd5b6 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08bade92d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.695969:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08bade92d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.695975:0:18958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91d00293a400) 00010000:00010000:2.0:1788940907.695977:0:18958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788940907.695980:0:18958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788940907.696020:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08bade91f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc774c expref: 15 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.696044:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0600/0x9c34acc08bade934 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc774c expref: 14 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.696051:0:18958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:2.0:1788940907.696054:0:18958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788940907.696056:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e0600, rc 0) 00000100:00100000:2.0:1788940907.698669:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+15:15667:x1875839921819776:12345-192.168.202.25@tcp:101:bash.0 Request processed in 21029us (23872us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788940907.698682:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 37 00000100:00100000:2.0:1788940907.724093:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940907.730333:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921820032 00000100:00100000:1.0:1788940907.730350:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921820032 00000100:00100000:1.0:1788940907.730431:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 38 00000100:00100000:1.0:1788940907.730442:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+15:15667:x1875839921820032:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:1.0:1788940907.730468:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940907.730490:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08bade942 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7753 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.730591:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade949 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.730607:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade949 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.730619:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade949 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940907.730673:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788940907.730677:0:17150:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788940907.730701:0:17150:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade949 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.730713:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade949 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.730739:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053a00/0x9c34acc08bade942 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7753 expref: 17 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.730780:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade949 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7753 expref: 16 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940907.730790:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:1.0:1788940907.730793:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940907.730797:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001218600, rc 0) 00000100:00100000:1.0:1788940907.730894:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+16:15667:x1875839921820032:12345-192.168.202.25@tcp:101:bash.0 Request processed in 454us (6812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940907.730902:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 38 00000100:00100000:0.0:1788940907.736905:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940907.737024:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921820288 00000100:00100000:3.0:1788940907.737046:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921820288 00000100:00100000:3.0:1788940907.737118:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:3.0:1788940907.737130:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+16:15667:x1875839921820288:12345-192.168.202.25@tcp:35:bash.0 00000100:00100000:3.0:1788940907.737483:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+17:15667:x1875839921820288:12345-192.168.202.25@tcp:35:bash.0 Request processed in 354us (1284us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788940907.737491:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 5 00000040:00080000:1.0:1788940907.803986:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788940907.895253:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940907.895591:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921820544 00000100:00100000:2.0:1788940907.895603:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921820544 00000100:00100000:2.0:1788940907.895738:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00100000:2.0:1788940907.895750:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+17:15677:x1875839921820544:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1788940907.895788:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940907.895816:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08bade950 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc775a expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940907.895945:0:18958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788940907.896067:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08bade950 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc775a expref: 19 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.896082:0:18958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d00293a800) 00010000:00010000:2.0:1788940907.896085:0:18958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940907.896090:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08bade950 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc775a expref: 19 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940907.896124:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e0200, rc 0) 00000100:00100000:2.0:1788940907.896202:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+18:15677:x1875839921820544:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 455us (960us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788940907.896209:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00100000:0.0:1788940907.910423:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940907.910551:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921820800 00000100:00100000:3.0:1788940907.910571:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921820800 00000100:00100000:3.0:1788940907.910701:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:3.0:1788940907.910723:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+18:15677:x1875839921820800:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:3.0:1788940907.911092:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+19:15677:x1875839921820800:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 370us (686us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788940907.911102:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:0.0:1788940908.020388:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940908.020483:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921821056 00000100:00100000:1.0:1788940908.020494:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921821056 00000100:00100000:1.0:1788940908.020557:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:1.0:1788940908.020569:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+19:15680:x1875839921821056:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788940908.020595:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940908.020617:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219200/0x9c34acc08bade95e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7761 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.020748:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade965 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.020764:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade965 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.020780:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade965 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940908.020810:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788940908.020942:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219200/0x9c34acc08bade95e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7761 expref: 22 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.020963:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade965 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7761 expref: 21 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.020972:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:1.0:1788940908.020975:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940908.020979:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001218000, rc 0) 00000100:00100000:1.0:1788940908.021054:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+21:15680:x1875839921821056:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 487us (678us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788940908.021063:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:1.0:1788940908.034940:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940908.035061:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921821184 00000100:00100000:0.0:1788940908.035072:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921821184 00000100:00100000:0.0:1788940908.035144:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 41 00000100:00100000:0.0:1788940908.035157:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+21:15680:x1875839921821184:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:0.0:1788940908.035251:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade973 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.035310:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade973 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.035323:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade973 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.035379:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade973 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.035388:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade973 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.035395:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade973 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.035402:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584c000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940908.035407:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade973 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.035415:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade973 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.035426:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:0.0:1788940908.035429:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940908.035435:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade973 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.035441:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade973 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940908.035529:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+21:15680:x1875839921821184:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 374us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940908.035537:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 41 00000100:00100000:0.0:1788940908.040616:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940908.040989:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921821568 00000100:00100000:3.0:1788940908.041003:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921821568 00000100:00100000:3.0:1788940908.041087:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:3.0:1788940908.041102:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+21:15680:x1875839921821568:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:3.0:1788940908.063030:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+22:15680:x1875839921821568:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 21911us (22411us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788940908.063053:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:1.0:1788940908.064604:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940908.064683:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921821312 00000100:00100000:3.0:1788940908.064719:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921821312 00000100:00100000:3.0:1788940908.064805:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:3.0:1788940908.064827:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+22:2405:x1875839921821312:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940908.064847:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940908.064954:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218000/0x9c34acc08bade965 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7761 expref: 22 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.064978:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:3.0:1788940908.064985:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940908.065070:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+21:2405:x1875839921821312:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 252us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940908.065078:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 0 00010000:00010000:1.0:1788940908.443764:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940908.471076:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940908.476081:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921821824 00000100:00100000:2.0:1788940908.476106:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921821824 00000100:00100000:2.0:1788940908.476228:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00100000:2.0:1788940908.476242:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+21:15711:x1875839921821824:12345-192.168.202.25@tcp:101:cat.0 00010000:00010000:2.0:1788940908.476448:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940908.476478:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0a00/0x9c34acc08bade97a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7768 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.476899:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1a00/0x9c34acc08bade981 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.476918:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1a00/0x9c34acc08bade981 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.476932:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1a00/0x9c34acc08bade981 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940908.476946:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788940908.477119:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0a00/0x9c34acc08bade97a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7768 expref: 24 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.477141:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1a00/0x9c34acc08bade981 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7768 expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.477953:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:2.0:1788940908.477961:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940908.477967:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e1a00, rc 0) 00000100:00100000:2.0:1788940908.478062:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+23:15711:x1875839921821824:12345-192.168.202.25@tcp:101:cat.0 Request processed in 1820us (6999us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788940908.478073:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00100000:2.0:1788940908.484790:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940908.484924:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940908.485302:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921822208 00000100:00100000:1.0:1788940908.485317:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921822208 00000100:00100000:1.0:1788940908.485405:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:1.0:1788940908.485418:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+23:2404:x1875839921822208:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940908.487960:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940908.488017:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1a00/0x9c34acc08bade981 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7768 expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.488044:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:1.0:1788940908.488071:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940908.488171:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+22:2404:x1875839921822208:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 2753us (3244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940908.488194:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:0.0:1788940908.494858:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921822080 00000100:00100000:0.0:1788940908.494885:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921822080 00000100:00100000:0.0:1788940908.495013:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:0.0:1788940908.495027:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+22:15711:x1875839921822080:12345-192.168.202.25@tcp:35:cat.0 00000100:00100000:0.0:1788940908.496093:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+23:15711:x1875839921822080:12345-192.168.202.25@tcp:35:cat.0 Request processed in 1060us (11384us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788940908.496107:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:2.0:1788940908.570317:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940908.570442:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921822464 00000100:00100000:0.0:1788940908.570456:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921822464 00000100:00100000:0.0:1788940908.570541:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:0.0:1788940908.570555:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+23:15717:x1875839921822464:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:0.0:1788940908.570591:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940908.570620:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d000/0x9c34acc08bade98f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc776f expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.570776:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade996 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.570796:0:18958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0600/0x9c34acc08bade934 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc774c expref: 24 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.570806:0:18958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade949 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7753 expref: 24 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.570816:0:18958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade996 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.570864:0:18958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade949 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7753 expref: 24 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.570904:0:18958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade949 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7753 expref: 24 pid: 17150 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940908.570922:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18958:1875839944988416:192.168.202.25@tcp:104: 00010000:00010000:0.0:1788940908.571051:0:18958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0600/0x9c34acc08bade934 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc774c expref: 24 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.571061:0:18958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0600/0x9c34acc08bade934 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc774c expref: 24 pid: 18958 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940908.571071:0:18958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18958:1875839944988544:192.168.202.25@tcp:104: 00000100:00100000:0.0:1788940908.571096:0:18958:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf017230c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940908.576114:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940908.576183:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940908.576302:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921822592 00000100:00100000:1.0:1788940908.576315:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921822592 00010000:00010000:1.0:1788940908.576368:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade949 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7753 expref: 25 pid: 17150 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940908.576418:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921822720 00000100:00100000:1.0:1788940908.576430:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921822720 00010000:00010000:1.0:1788940908.576444:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0600/0x9c34acc08bade934 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc774c expref: 26 pid: 18958 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940908.576462:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:1.0:1788940908.576474:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+26:2405:x1875839921822592:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940908.576493:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940908.576501:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade949 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7753 expref: 26 pid: 17150 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.576519:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade949 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7753 expref: 26 pid: 17150 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.576551:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:1.0:1788940908.576558:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade996 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.576567:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade996 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.576583:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940908.576656:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+26:2405:x1875839921822592:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 184us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940908.576665:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:1.0:1788940908.576685:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:1.0:1788940908.576692:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037739c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+25:2405:x1875839921822720:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940908.576701:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940908.576706:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0600/0x9c34acc08bade934 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc774c expref: 25 pid: 18958 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.576716:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0600/0x9c34acc08bade934 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc774c expref: 25 pid: 18958 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.576729:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:1.0:1788940908.576733:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade996 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.576742:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade996 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.576751:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade996 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.576775:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940908.576794:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037739c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+25:2405:x1875839921822720:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 102us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940908.576801:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 18 00010000:00010000:0.0:1788940908.577333:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08bade949 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7753 expref: 24 pid: 17150 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940908.577355:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18958:1875839944988416:192.168.202.25@tcp:104: 00010000:00010000:0.0:1788940908.577370:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0600/0x9c34acc08bade934 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc774c expref: 23 pid: 18958 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940908.577381:0:18958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18958:1875839944988544:192.168.202.25@tcp:104: 00010000:00010000:0.0:1788940908.577405:0:18958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade996 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.577416:0:18958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade996 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.577497:0:18958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade996 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940908.577522:0:18958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788940908.577728:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d000/0x9c34acc08bade98f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc776f expref: 24 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.577747:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade996 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc776f expref: 23 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.577756:0:18958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:0.0:1788940908.577759:0:18958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788940908.577762:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c000, rc 0) 00000100:00100000:0.0:1788940908.577827:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+23:15717:x1875839921822464:12345-192.168.202.25@tcp:101:dd.0 Request processed in 7276us (7569us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788940908.577835:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:2.0:1788940908.583419:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940908.583696:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921822848 00000100:00100000:1.0:1788940908.583708:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921822848 00000100:00100000:1.0:1788940908.583781:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:1.0:1788940908.583792:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+23:15717:x1875839921822848:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:1.0:1788940908.583823:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940908.583848:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219e00/0x9c34acc08bade9a4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7776 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.583884:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade9ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.583911:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade9ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.583924:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade9ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.584068:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219e00/0x9c34acc08bade9a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7776 expref: 25 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.584089:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade9ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7776 expref: 24 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.584098:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:1.0:1788940908.584102:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788940908.584105:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001218800, rc 0) 00000100:00100000:1.0:1788940908.584185:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+24:15717:x1875839921822848:12345-192.168.202.25@tcp:101:dd.0 Request processed in 395us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940908.584194:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:1.0:1788940908.590485:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940908.590625:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921823104 00000100:00100000:0.0:1788940908.590644:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921823104 00000100:00100000:0.0:1788940908.590746:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00100000:0.0:1788940908.590759:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+24:15717:x1875839921823104:12345-192.168.202.25@tcp:36:dd.0 00010000:00010000:0.0:1788940908.591084:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d000/0x9c34acc08bade9b2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.591107:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d000/0x9c34acc08bade9b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.591122:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d000/0x9c34acc08bade9b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940908.591215:0:17151:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788940908.591242:0:17151:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f67f7af1 reply state 000000006faeacdb transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d000/0x9c34acc08bade9b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.591292:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d000/0x9c34acc08bade9b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.591302:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:0.0:1788940908.591306:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788940908.591311:0:17151:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940908.591449:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+27:15717:x1875839921823104:12345-192.168.202.25@tcp:36:dd.0 Request processed in 691us (971us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788940908.591457:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 45 00000020:00080000:0.0:1788940908.591465:0:17151:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788940908.594218:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940908.594323:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921823232 00000100:00100000:2.0:1788940908.594336:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921823232 00000100:00100000:2.0:1788940908.594400:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:2.0:1788940908.594410:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+27:15717:x1875839921823232:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:2.0:1788940908.594436:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940908.594456:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1600/0x9c34acc08bade9b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc777d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.594516:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1600/0x9c34acc08bade9b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc777d expref: 28 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.594532:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1600/0x9c34acc08bade9b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc777d expref: 28 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.594572:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:2.0:1788940908.594575:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940908.594591:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e1600, rc 0) 00000100:00100000:2.0:1788940908.594659:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+28:15717:x1875839921823232:12345-192.168.202.25@tcp:101:dd.0 Request processed in 250us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940908.594667:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:2.0:1788940908.611989:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940908.612097:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921823488 00000100:00100000:1.0:1788940908.612108:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921823488 00000100:00100000:1.0:1788940908.612189:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:1.0:1788940908.612199:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+28:15717:x1875839921823488:12345-192.168.202.25@tcp:103:dd.0 00010000:00010000:1.0:1788940908.612218:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940908.612244:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1600/0x9c34acc08bade9b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc777d expref: 28 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.612299:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:1.0:1788940908.612304:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940908.612369:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+27:15717:x1875839921823488:12345-192.168.202.25@tcp:103:dd.0 Request processed in 171us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940908.612376:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:3.0:1788940908.616154:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940908.616403:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921823616 00000100:00100000:2.0:1788940908.616415:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921823616 00000100:00100000:2.0:1788940908.616485:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:2.0:1788940908.616495:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+27:15717:x1875839921823616:12345-192.168.202.25@tcp:58:dd.0 00010000:00010000:2.0:1788940908.616631:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1200/0x9c34acc08bade9c0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.616649:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1200/0x9c34acc08bade9c0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.616661:0:18958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1200/0x9c34acc08bade9c0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788940908.618169:0:18958:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788940908.619126:0:18958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788940908.619331:0:18958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788940908.619445:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+27:15717:x1875839921823616:12345-192.168.202.25@tcp:58:dd.0 Request processed in 2945us (3297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940908.619458:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:2.0:1788940908.622447:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940908.622670:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921823744 00000100:00100000:1.0:1788940908.622681:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921823744 00000100:00100000:1.0:1788940908.622768:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 48 00000100:00100000:1.0:1788940908.622778:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+27:15717:x1875839921823744:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:1.0:1788940908.622798:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940908.622816:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219e00/0x9c34acc08bade9c7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7784 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.622870:0:17150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1200/0x9c34acc08bade9c0 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.622880:0:17150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219e00/0x9c34acc08bade9c7 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7784 expref: 28 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.622921:0:17150:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1200/0x9c34acc08bade9c0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.622934:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219e00/0x9c34acc08bade9c7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7784 expref: 28 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.622947:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:1.0:1788940908.622949:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940908.622953:0:17150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219e00/0x9c34acc08bade9c7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7784 expref: 28 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.622962:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219e00, rc 0) 00000100:00100000:1.0:1788940908.623052:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+28:15717:x1875839921823744:12345-192.168.202.25@tcp:101:dd.0 Request processed in 275us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940908.623059:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 48 00000100:00100000:2.0:1788940908.699676:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944988672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940908.699802:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940908.703498:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944988672 00000100:00100000:3.0:1788940908.703521:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944988672 00000100:00100000:3.0:1788940908.703582:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940908.703592:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944988672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940908.703627:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788940908.703714:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944988672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (3911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940908.703721:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788940908.704418:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944988672:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788940908.827872:0:17184:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788940908.827884:0:17184:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940908.828596:0:17184:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788940908.828607:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788940908.829320:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012af480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17184:1875839944988800:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788940908.829500:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a4a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940908.852394:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940908.852683:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012af480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17184:1875839944988800:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788940908.852841:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921823872 00000100:00100000:0.0:1788940908.852850:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921823872 00000100:00100000:0.0:1788940908.852916:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 49 00000100:00100000:0.0:1788940908.852927:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+28:15718:x1875839921823872:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788940908.852964:0:17151:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788940908.853138:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+28:15718:x1875839921823872:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 212us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940908.853146:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 49 00000100:00100000:0.0:1788940908.871933:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940908.872081:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921824000 00000100:00100000:2.0:1788940908.872093:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921824000 00000100:00100000:2.0:1788940908.872160:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 50 00000100:00100000:2.0:1788940908.872179:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+28:15718:x1875839921824000:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788940908.872295:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08bade9ce lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.872314:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08bade9ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.872330:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08bade9ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.872374:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08bade9d5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.872382:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08bade9d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.872389:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08bade9d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.872415:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08bade9dc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.872424:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08bade9dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.872450:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08bade9dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940908.872505:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788940908.873823:0:17152:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788940908.873855:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08bade9dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.873872:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08bade9ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.873879:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08bade9ce lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.873887:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08bade9ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.873893:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940908.873898:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08bade9ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.873907:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08bade9ce lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.873921:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d0207afe00) 00010000:00010000:2.0:1788940908.873924:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940908.873929:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08bade9ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.873935:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08bade9ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.873968:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08bade9d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.873974:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08bade9d5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.873980:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08bade9d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.873985:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940908.873988:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08bade9d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.873994:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08bade9d5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.874002:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff91d00293a200) 00010000:00010000:2.0:1788940908.874004:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940908.874008:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08bade9d5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.874013:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08bade9d5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.874443:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08bade9dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.874452:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08bade9dc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.874458:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08bade9dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.874471:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940908.874474:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08bade9dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.874481:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08bade9dc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.874491:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:2.0:1788940908.874494:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940908.874498:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08bade9dc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.874504:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08bade9dc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940908.874615:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+28:15718:x1875839921824000:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 Request processed in 2443us (2691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940908.874626:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 50 00000100:00100000:3.0:1788940908.877415:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940908.877523:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921824256 00000100:00100000:0.0:1788940908.877534:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921824256 00000100:00100000:0.0:1788940908.877595:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:0.0:1788940908.877621:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+28:15718:x1875839921824256:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940908.877644:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940908.877663:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c400/0x9c34acc08bade9e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc778b expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.877780:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ce00/0x9c34acc08bade9ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.877797:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ce00/0x9c34acc08bade9ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.877810:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ce00/0x9c34acc08bade9ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940908.877822:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788940908.877915:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ce00/0x9c34acc08bade9ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.877922:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ce00/0x9c34acc08bade9ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.877928:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ce00/0x9c34acc08bade9ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.877933:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584ce00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940908.877937:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ce00/0x9c34acc08bade9ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.877945:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ce00/0x9c34acc08bade9ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.877956:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:0.0:1788940908.877965:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788940908.877971:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ce00/0x9c34acc08bade9ea lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.877977:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ce00/0x9c34acc08bade9ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.878022:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c400/0x9c34acc08bade9e3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc778b expref: 30 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.878033:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d0207afe00) 00010000:00010000:0.0:1788940908.878035:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940908.878040:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c400/0x9c34acc08bade9e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc778b expref: 30 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.878050:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c400, rc 0) 00000100:00100000:0.0:1788940908.878199:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+29:15718:x1875839921824256:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 581us (792us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788940908.878206:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:3.0:1788940908.888101:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940908.888208:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921824384 00000100:00100000:1.0:1788940908.888220:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921824384 00000100:00100000:1.0:1788940908.888440:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:1.0:1788940908.888454:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+29:15718:x1875839921824384:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788940908.888586:0:17150:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788940908.888715:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+29:15718:x1875839921824384:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 264us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940908.888724:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:3.0:1788940908.894113:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940908.894228:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921824640 00000100:00100000:0.0:1788940908.894240:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921824640 00000100:00100000:0.0:1788940908.894336:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:0.0:1788940908.894347:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+29:15718:x1875839921824640:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940908.894370:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940908.894391:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c400/0x9c34acc08bade9f8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7792 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788940908.894959:0:17151:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:0.0:1788940908.894989:0:17151:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788940908.895012:0:17151:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788940908.895168:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ce00/0x9c34acc08bade9ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.895195:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ce00/0x9c34acc08bade9ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.895209:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ce00/0x9c34acc08bade9ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.895301:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c400/0x9c34acc08bade9f8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7792 expref: 32 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.895320:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ce00/0x9c34acc08bade9ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7792 expref: 31 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.895328:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d02e967300) 00010000:00010000:0.0:1788940908.895332:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940908.895336:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584ce00, rc 0) 00000100:00100000:0.0:1788940908.895410:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+31:15718:x1875839921824640:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1064us (1305us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788940908.895420:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:3.0:1788940908.901160:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940908.901335:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921824896 00000100:00100000:2.0:1788940908.901346:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921824896 00000100:00100000:2.0:1788940908.901408:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:2.0:1788940908.901421:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+31:15718:x1875839921824896:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788940908.901487:0:17152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940908.901527:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584ce00/0x9c34acc08bade9ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7792 expref: 31 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901547:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d02e967300) 00010000:00010000:2.0:1788940908.901558:0:17152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940908.901597:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea0d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901611:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901621:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901635:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08badea14 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7843a6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901642:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08badea14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7843a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901648:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08badea14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7843a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901698:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901707:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea0d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901716:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea0d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901722:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940908.901726:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea0d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901897:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea0d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901920:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91cf06dfcd00) 00010000:00010000:2.0:1788940908.901922:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940908.901926:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea0d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901932:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea0d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901943:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08badea14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7843a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901950:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08badea14 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7843a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901956:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08badea14 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7843a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901962:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940908.901964:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08badea14 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7843a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901971:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08badea14 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7843a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901978:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x7843a6e (ffff91d00293a200) 00010000:00010000:2.0:1788940908.901981:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940908.901984:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08badea14 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7843a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.901989:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1800/0x9c34acc08badea14 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7843a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940908.902103:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+30:15718:x1875839921824896:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 684us (953us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788940908.902111:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:3.0:1788940908.905952:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940908.906195:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921825024 00000100:00100000:0.0:1788940908.906208:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921825024 00000100:00100000:0.0:1788940908.906316:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:0.0:1788940908.906328:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+30:15718:x1875839921825024:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940908.906352:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940908.906379:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c400/0x9c34acc08badea1b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7799 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.906433:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c600/0x9c34acc08badea22 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.906449:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c600/0x9c34acc08badea22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.906464:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c600/0x9c34acc08badea22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.906614:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c400/0x9c34acc08badea1b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7799 expref: 32 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.906634:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c600/0x9c34acc08badea22 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7799 expref: 31 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.906643:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d02e967100) 00010000:00010000:0.0:1788940908.906646:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788940908.906650:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c600, rc 0) 00000100:00100000:0.0:1788940908.906838:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+31:15718:x1875839921825024:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 511us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940908.906846:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:3.0:1788940908.912707:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940908.912786:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921825280 00000100:00100000:1.0:1788940908.912798:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921825280 00000100:00100000:1.0:1788940908.912861:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:1.0:1788940908.912872:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+31:15718:x1875839921825280:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788940908.912968:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badea29 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.912986:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badea29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.912999:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badea29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940908.913215:0:17150:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1788940908.913226:0:17150:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 664245968109ns, next at 665245965543ns, rc = 0 00000004:00010000:1.0:1788940908.913307:0:17150:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000dea073b reply state 00000000936e92b7 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badea29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.913321:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badea29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.913329:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d02e967100) 00010000:00010000:1.0:1788940908.913332:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788940908.913336:0:17150:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940908.913672:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+33:15718:x1875839921825280:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 800us (975us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788940908.913696:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:3.0:1788940908.916710:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940908.917084:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921825408 00000100:00100000:0.0:1788940908.917095:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921825408 00000100:00100000:0.0:1788940908.917197:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:0.0:1788940908.917208:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+33:15718:x1875839921825408:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940908.917237:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940908.917287:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584da00/0x9c34acc08badea30 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc77a0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.917363:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584da00/0x9c34acc08badea30 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77a0 expref: 34 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.917381:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584da00/0x9c34acc08badea30 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77a0 expref: 34 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.917399:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d02e967100) 00010000:00010000:0.0:1788940908.917402:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788940908.917406:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584da00, rc 0) 00000100:00100000:0.0:1788940908.917520:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+34:15718:x1875839921825408:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 314us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940908.917528:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:0.0:1788940908.921094:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940908.921190:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921825536 00000100:00100000:2.0:1788940908.921201:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921825536 00000100:00100000:2.0:1788940908.921297:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:2.0:1788940908.921307:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2404:x1875839921825536:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788940908.921611:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940908.921792:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:2404:x1875839921825536:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 485us (707us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788940908.921801:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:2.0:1788940908.927192:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940908.927445:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921825792 00000100:00100000:3.0:1788940908.927457:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921825792 00000100:00100000:3.0:1788940908.927519:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:3.0:1788940908.927530:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+34:15718:x1875839921825792:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788940908.927767:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+35:15718:x1875839921825792:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 239us (594us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1788940908.927775:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:2.0:1788940908.930553:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940908.930655:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921826048 00000100:00100000:3.0:1788940908.930666:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921826048 00000100:00100000:3.0:1788940908.930728:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:3.0:1788940908.930748:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+35:15718:x1875839921826048:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788940908.930862:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+35:15718:x1875839921826048:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 116us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940908.930869:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:2.0:1788940908.935098:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940908.935764:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921826176 00000100:00100000:0.0:1788940908.935783:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921826176 00000100:00100000:0.0:1788940908.935880:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:0.0:1788940908.935891:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+35:15718:x1875839921826176:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940908.935914:0:18958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940908.935939:0:18958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c400/0x9c34acc08badea37 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc77a7 expref: -99 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.936034:0:18958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584cc00/0x9c34acc08badea3e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.936050:0:18958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584cc00/0x9c34acc08badea3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.936082:0:18958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584cc00/0x9c34acc08badea3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940908.936133:0:18958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788940908.936155:0:18958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584cc00/0x9c34acc08badea3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.936196:0:18958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c400/0x9c34acc08badea37 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77a7 expref: 37 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.936216:0:18958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584cc00/0x9c34acc08badea3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77a7 expref: 36 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.936224:0:18958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d02e967100) 00010000:00010000:0.0:1788940908.936227:0:18958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788940908.936231:0:18958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584cc00, rc 0) 00000100:00100000:0.0:1788940908.936367:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+36:15718:x1875839921826176:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 478us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940908.936375:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:3.0:1788940908.941631:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940908.941842:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921826304 00000100:00100000:1.0:1788940908.941854:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921826304 00000100:00100000:1.0:1788940908.941923:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:1.0:1788940908.941934:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:2404:x1875839921826304:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940908.941952:0:18670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940908.941973:0:18670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badea45 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc77ae expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940908.941999:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa1126d, blocks: 0x0 00010000:00010000:1.0:1788940908.942020:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=664s v=(0 0) 00010000:00010000:1.0:1788940908.942025:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940908.942036:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badea45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77ae expref: 7 pid: 18670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.942055:0:18670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badea45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77ae expref: 7 pid: 18670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.942069:0:18670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219400, rc 0) 00000100:00100000:1.0:1788940908.942133:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+7:2404:x1875839921826304:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 201us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940908.942140:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:3.0:1788940908.945770:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940908.945983:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921826560 00000100:00100000:2.0:1788940908.945994:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921826560 00000100:00100000:2.0:1788940908.946063:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 60 00000100:00100000:2.0:1788940908.946073:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+36:15718:x1875839921826560:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788940908.946208:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+36:15718:x1875839921826560:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 135us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940908.946216:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 60 00000100:00100000:2.0:1788940908.950822:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940908.950937:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921826688 00000100:00100000:0.0:1788940908.950949:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921826688 00000100:00100000:0.0:1788940908.951025:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 61 00000100:00100000:0.0:1788940908.951038:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+36:15718:x1875839921826688:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788940908.953568:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1788940908.953587:0:17130:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788940908.953636:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:1.0:1788940908.953813:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053c00/0x9c34acc08bade87e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.953827:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053c00/0x9c34acc08bade87e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.953848:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053c00/0x9c34acc08bade87e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.953855:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042053c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940908.953861:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053c00/0x9c34acc08bade87e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.953871:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053c00/0x9c34acc08bade87e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.953888:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91cf06dfc400) 00010000:00010000:1.0:1788940908.953902:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940908.953909:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053c00/0x9c34acc08bade87e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.953917:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053c00/0x9c34acc08bade87e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.953938:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053000/0x9c34acc08bade885 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.953945:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053000/0x9c34acc08bade885 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.953951:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053000/0x9c34acc08bade885 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.953956:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042053000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940908.953959:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053000/0x9c34acc08bade885 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.953986:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053000/0x9c34acc08bade885 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.953996:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91cf06dfcd00) 00010000:00010000:1.0:1788940908.953998:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940908.954001:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053000/0x9c34acc08bade885 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954007:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053000/0x9c34acc08bade885 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954023:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08bade92d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954029:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08bade92d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954035:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08bade92d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954040:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940908.954043:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08bade92d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954048:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08bade92d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954056:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91d00293a400) 00010000:00010000:1.0:1788940908.954059:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940908.954062:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08bade92d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954074:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08bade92d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954091:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d000/0x9c34acc08bade9b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954097:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d000/0x9c34acc08bade9b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954103:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d000/0x9c34acc08bade9b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954108:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584d000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940908.954111:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d000/0x9c34acc08bade9b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954117:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d000/0x9c34acc08bade9b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954125:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:1.0:1788940908.954128:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940908.954130:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d000/0x9c34acc08bade9b2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954135:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d000/0x9c34acc08bade9b2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954147:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badea29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954152:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badea29 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954165:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badea29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954178:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788940908.954182:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badea29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954188:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badea29 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954196:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d02e967100) 00010000:00010000:1.0:1788940908.954199:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788940908.954201:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badea29 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.954206:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badea29 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.954404:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052c00/0x9c34acc08bade8d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.954413:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052c00/0x9c34acc08bade8d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.954426:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052c00/0x9c34acc08bade8d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.954432:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042052c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788940908.954435:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052c00/0x9c34acc08bade8d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.954441:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052c00/0x9c34acc08bade8d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.954449:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91cf06dfcd00) 00010000:00010000:0.0:1788940908.954452:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788940908.954455:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052c00/0x9c34acc08bade8d2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.954461:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d042052c00/0x9c34acc08bade8d2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940908.954614:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+15:15718:x1875839921826688:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 Request processed in 3575us (3801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940908.954625:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 61 00000100:00100000:1.0:1788940908.955010:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944988928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788940908.955073:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940908.955130:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944988928 00000100:00100000:1.0:1788940908.955138:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944988928 00000100:00100000:1.0:1788940908.955189:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788940908.955199:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944988928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788940908.955363:0:18669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788940908.955367:0:18669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788940908.955369:0:18669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788940908.955372:0:18669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788940909 -> 1788940909 00002000:00010000:1.0:1788940908.955374:0:18669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788940908.955424:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875839944988928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 226us (350us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788940908.955431:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:1.0:1788940908.955481:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d0065d1880/2, rc 0, transno 8589934596 00000100:00100000:1.0:1788940908.955488:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944988928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788940908.959520:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940908.959627:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921826816 00000100:00100000:1.0:1788940908.959637:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921826816 00000100:00100000:1.0:1788940908.959696:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:1.0:1788940908.959706:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+7:2405:x1875839921826816:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788940908.959819:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+7:2405:x1875839921826816:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 Request processed in 113us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940908.959827:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:3.0:1788940908.966115:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940908.966218:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921827072 00000100:00100000:2.0:1788940908.966229:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921827072 00000100:00100000:2.0:1788940908.966323:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 62 00000100:00100000:2.0:1788940908.966336:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+15:15718:x1875839921827072:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788940908.966408:0:17152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940908.966435:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584cc00/0x9c34acc08badea3e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77a7 expref: 15 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.966454:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d02e967100) 00010000:00010000:2.0:1788940908.966460:0:17152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940908.966492:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea4c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.966517:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea4c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.966536:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea4c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940908.966668:0:17152:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041963b31 reply state 00000000f121c737 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea4c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.966682:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.966688:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d02e967100) 00010000:00010000:2.0:1788940908.966691:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788940908.966694:0:17152:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940908.966812:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+16:15718:x1875839921827072:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 478us (707us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788940908.966819:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 62 00000100:00100000:2.0:1788940908.970627:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940908.970715:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921827200 00000100:00100000:1.0:1788940908.970727:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921827200 00000100:00100000:1.0:1788940908.970797:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:1.0:1788940908.970808:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+7:15718:x1875839921827200:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940908.970826:0:18669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940908.970845:0:18669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08badea53 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc77b5 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.970878:0:18669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badea45 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77ae expref: 8 pid: 18670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.970888:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940908.970902:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940908.970909:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08badea53 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77b5 expref: 8 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.970963:0:18669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badea45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77ae expref: 8 pid: 18670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.970977:0:18669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badea45 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77ae expref: 8 pid: 18670 timeout: 764 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940908.970992:0:18669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18669:1875839944989056:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940908.971078:0:18669:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a4a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940908.975722:0:18669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18669:1875839944989056:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940908.975772:0:18669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08badea53 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77b5 expref: 8 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.975795:0:18669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219a00, rc 0) 00000100:00100000:1.0:1788940908.975874:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+8:15718:x1875839921827200:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 5067us (5256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940908.975884:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:3.0:1788940908.979443:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940908.979553:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921827328 00000100:00100000:2.0:1788940908.979564:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921827328 00010000:00010000:2.0:1788940908.979616:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badea45 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77ae expref: 8 pid: 18670 timeout: 764 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940908.979664:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:2.0:1788940908.979675:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+8:2404:x1875839921827328:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940908.979692:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940908.979713:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badea45 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77ae expref: 8 pid: 18670 timeout: 764 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.979728:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badea45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77ae expref: 8 pid: 18670 timeout: 764 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.979765:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badea45 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77ae expref: 8 pid: 18670 timeout: 764 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.979783:0:17136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940908.979787:0:17136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940908.979794:0:17136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08badea53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77b5 expref: 7 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.979805:0:17136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08badea53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77b5 expref: 7 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.979842:0:17136:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08badea53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77b5 expref: 7 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940908.979870:0:17136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17136:1875839944989184:192.168.202.25@tcp:105: 00000100:00100000:2.0:1788940908.979966:0:17136:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00c89ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940908.984304:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940908.984381:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921827456 00000100:00100000:1.0:1788940908.984392:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921827456 00000100:00100000:1.0:1788940908.984455:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:1.0:1788940908.984467:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+8:2407:x1875839921827456:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788940908.984640:0:18670:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788940908.984645:0:18670:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788940909 00002000:00010000:1.0:1788940908.984647:0:18670:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788940908 00002000:00010000:1.0:1788940908.984668:0:18670:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788940909 -> 1788940909 00002000:00010000:1.0:1788940908.984671:0:18670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788940908.984755:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+9:2407:x1875839921827456:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 290us (461us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788940908.984764:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:3.0:1788940908.985648:0:17136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17136:1875839944989184:192.168.202.25@tcp:105: 00010000:00010000:3.0:1788940908.985681:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940908.985751:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+8:2404:x1875839921827328:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 6077us (6317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940908.985761:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:2.0:1788940908.990208:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940908.990309:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921827584 00000100:00100000:0.0:1788940908.990322:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921827584 00000100:00100000:0.0:1788940908.990384:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:0.0:1788940908.990394:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+8:2405:x1875839921827584:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788940908.990446:0:19149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08badea5a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.990468:0:19149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08badea53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77b5 expref: 8 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.990492:0:19149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940908.990496:0:19149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940908.990501:0:19149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08badea5a lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.990539:0:19149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08badea53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77b5 expref: 8 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.990555:0:19149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08badea53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77b5 expref: 8 pid: 18669 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940908.990571:0:19149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19149:1875839944989312:192.168.202.25@tcp:104: 00000100:00100000:0.0:1788940908.990652:0:19149:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf01723180 going to sleep for 11 seconds 00000100:00100000:2.0:1788940908.995500:0:19149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19149:1875839944989312:192.168.202.25@tcp:104: 00010000:00010000:2.0:1788940908.995548:0:19149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08badea5a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940908.998145:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940908.998384:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921827712 00000100:00100000:3.0:1788940908.998395:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921827712 00010000:00010000:3.0:1788940908.998438:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08badea53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77b5 expref: 9 pid: 18669 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940908.998486:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:3.0:1788940908.998496:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+9:2407:x1875839921827712:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940908.998522:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940908.998546:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08badea53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77b5 expref: 9 pid: 18669 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.998562:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08badea53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77b5 expref: 9 pid: 18669 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.998587:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000521df18e/0x9c34acc08badea53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77b5 expref: 9 pid: 18669 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.998605:0:17135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940908.998609:0:17135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940908.998616:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08badea5a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.998627:0:17135:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08badea5a lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.998676:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940908.998750:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+8:2407:x1875839921827712:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 255us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940908.998758:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 20 00010000:00010000:2.0:1788940908.998979:0:19149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08badea5a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.998989:0:19149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08badea5a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.999012:0:19149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08badea5a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.999021:0:19149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08badea5a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.999029:0:19149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08badea5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.999049:0:19149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584d600 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788940908.999053:0:19149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08badea5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.999062:0:19149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08badea5a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.999076:0:19149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08badea5a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.999083:0:19149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be0b9bc4/0x9c34acc08badea5a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940908.999133:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+7:2405:x1875839921827584:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 Request processed in 8740us (8935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940908.999141:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:0.0:1788940909.004479:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940909.004646:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921827968 00000100:00100000:1.0:1788940909.004659:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921827968 00000100:00100000:1.0:1788940909.004786:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 63 00000100:00100000:1.0:1788940909.004797:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+16:15718:x1875839921827968:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788940909.004930:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badea61 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.004950:0:17151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade9ab lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7776 expref: 16 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.004961:0:17151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badea61 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.005016:0:17151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade9ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7776 expref: 16 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.005032:0:17151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade9ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7776 expref: 16 pid: 17152 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940909.005047:0:17151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17151:1875839944989440:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940909.005140:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a4a9c0 going to sleep for 11 seconds 00000100:00080000:0.0:1788940909.007685:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940909.010455:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940909.010547:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921828096 00000100:00100000:3.0:1788940909.010559:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921828096 00010000:00010000:3.0:1788940909.010603:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade9ab lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7776 expref: 17 pid: 17152 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940909.010651:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:3.0:1788940909.010662:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+17:2405:x1875839921828096:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940909.010677:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940909.010684:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade9ab lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7776 expref: 17 pid: 17152 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.010698:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade9ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7776 expref: 17 pid: 17152 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.010720:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:3.0:1788940909.010726:0:17136:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219e00/0x9c34acc08bade9c7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7784 expref: 17 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.010747:0:17136:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badea61 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.010755:0:17136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badea61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.010775:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badea61 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.010795:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940909.010860:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+17:2405:x1875839921828096:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 199us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940909.010867:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00010000:00010000:1.0:1788940909.011682:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218800/0x9c34acc08bade9ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7776 expref: 16 pid: 17152 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940909.011719:0:17151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17151:1875839944989440:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940909.011756:0:17151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badea61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.011766:0:17151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badea61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.011773:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badea61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.012107:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08badea68 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.012121:0:17151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584da00/0x9c34acc08badea30 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77a0 expref: 16 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.012129:0:17151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08badea68 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.012162:0:17151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584da00/0x9c34acc08badea30 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77a0 expref: 16 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.012189:0:17151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584da00/0x9c34acc08badea30 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77a0 expref: 16 pid: 17151 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940909.012205:0:17151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17151:1875839944989568:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788940909.013282:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03117b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940909.017106:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940909.017240:0:17151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17151:1875839944989568:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788940909.017304:0:17151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08badea68 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940909.017650:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921828224 00000100:00100000:3.0:1788940909.017660:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921828224 00010000:00010000:3.0:1788940909.017699:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584da00/0x9c34acc08badea30 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77a0 expref: 17 pid: 17151 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940909.017740:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:3.0:1788940909.017751:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+17:2405:x1875839921828224:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940909.017766:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940909.017774:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584da00/0x9c34acc08badea30 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77a0 expref: 17 pid: 17151 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.017787:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584da00/0x9c34acc08badea30 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77a0 expref: 17 pid: 17151 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.017809:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584da00/0x9c34acc08badea30 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77a0 expref: 17 pid: 17151 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.017825:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d02e967100) 00010000:00010000:3.0:1788940909.017830:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08badea68 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.017856:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08badea68 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.017864:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08badea68 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.018045:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940909.018105:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+16:2405:x1875839921828224:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 355us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940909.018113:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00010000:00010000:1.0:1788940909.019865:0:17151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08badea68 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.019880:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08badea68 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788940909.020184:0:17151:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788940909.020426:0:17151:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788940909.020467:0:17151:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788940909.020620:0:17151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0012aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17151:1875839944989696:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788940909.020685:0:17151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940909.020826:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0061eb780 going to sleep for 11 seconds 00000100:00100000:0.0:1788940909.020875:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944989696 00000100:00100000:0.0:1788940909.020884:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944989696 00000100:00100000:0.0:1788940909.021187:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788940909.021198:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17151:x1875839944989696:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788940909.021329:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17151:x1875839944989696:12345-0@lo:1000:mdt00_001.0 Request processed in 133us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940909.021337:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788940909.021459:0:17151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0012aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17151:1875839944989696:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788940909.021630:0:17151:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1788940909.021687:0:17151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17151:1875839944989824:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788940909.021723:0:17151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940909.021957:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a4a9c0 going to sleep for 11 seconds 00000100:00080000:2.0:1788940909.022066:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940909.022100:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944989824 00000100:00100000:0.0:1788940909.022106:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944989824 00000100:00100000:0.0:1788940909.022148:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788940909.022157:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17151:x1875839944989824:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788940909.022460:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17151:x1875839944989824:12345-0@lo:1000:mdt00_001.0 Request processed in 303us (735us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788940909.022468:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788940909.022558:0:17151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17151:1875839944989824:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788940909.022598:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08badea68 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.022610:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08badea68 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.022618:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08badea68 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.022634:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940909.022639:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08badea68 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.022648:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08badea68 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.022665:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d02e967100) 00010000:00010000:2.0:1788940909.022668:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940909.022674:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08badea68 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.022680:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08badea68 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.022713:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1200/0x9c34acc08bade9c0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.022720:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1200/0x9c34acc08bade9c0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.022725:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1200/0x9c34acc08bade9c0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.022848:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940909.022852:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1200/0x9c34acc08bade9c0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.022859:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1200/0x9c34acc08bade9c0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.022879:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:2.0:1788940909.022881:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940909.022898:0:17151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219e00/0x9c34acc08bade9c7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7784 expref: 19 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.022910:0:17151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219e00/0x9c34acc08bade9c7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7784 expref: 19 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.022919:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219e00/0x9c34acc08bade9c7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7784 expref: 19 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.022976:0:17151:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219e00/0x9c34acc08bade9c7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7784 expref: 19 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940909.022990:0:17151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17151:1875839944989952:192.168.202.25@tcp:105: 00000100:00100000:2.0:1788940909.023066:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00c89c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940909.027340:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940909.027495:0:17151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17151:1875839944989952:192.168.202.25@tcp:105: 00010000:00010000:2.0:1788940909.027541:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1200/0x9c34acc08bade9c0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.027553:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1200/0x9c34acc08bade9c0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.027585:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1600/0x9c34acc08badea6f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.027600:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1600/0x9c34acc08badea6f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.027626:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1600/0x9c34acc08badea6f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.027638:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1600/0x9c34acc08badea6f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.027644:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1600/0x9c34acc08badea6f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.027650:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1600/0x9c34acc08badea6f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.027655:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940909.027660:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1600/0x9c34acc08badea6f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.027666:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1600/0x9c34acc08badea6f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.027678:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:2.0:1788940909.027681:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940909.027684:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1600/0x9c34acc08badea6f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.027690:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1600/0x9c34acc08badea6f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.027700:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badea61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.027705:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badea61 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.027720:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badea61 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.027725:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788940909.027739:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badea61 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.027746:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badea61 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.027755:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:2.0:1788940909.027757:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788940909.027761:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badea61 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.027767:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badea61 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940909.027949:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+19:15718:x1875839921827968:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 23151us (23480us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788940909.027959:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 63 00000020:00080000:2.0:1788940909.027966:0:17151:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788940909.028230:0:17184:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788940909.028235:0:17184:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940909.028300:0:17184:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788940909.028309:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788940909.028529:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921828352 00000100:00100000:3.0:1788940909.028538:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921828352 00000100:00100000:3.0:1788940909.028588:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:3.0:1788940909.028598:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034727050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+19:15717:x1875839921828352:12345-192.168.202.25@tcp:49:dd.0 00000100:00100000:3.0:1788940909.028702:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034727050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+19:15717:x1875839921828352:12345-192.168.202.25@tcp:49:dd.0 Request processed in 105us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940909.028710:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:0.0:1788940909.033710:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940909.033855:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921828608 00000100:00100000:3.0:1788940909.033867:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921828608 00000100:00100000:3.0:1788940909.033937:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00100000:3.0:1788940909.033947:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+19:15718:x1875839921828608:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788940909.034314:0:17153:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788940909.034348:0:17153:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1788940909.034382:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08badea76 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.034401:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08badea76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.034413:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08badea76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.034422:0:17153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08badea76 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.034429:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08badea76 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.034435:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08badea76 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.034447:0:17153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940909.034817:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940909.034825:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08badea76 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940909.034833:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940909.034837:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08badea76 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940909.034846:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08badea76 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940909.034858:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d02e967100) 00010000:00010000:0.0:1788940909.034862:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788940909.034867:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08badea76 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940909.034873:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937800/0x9c34acc08badea76 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940909.034885:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940909.034887:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940909.034889:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940909.034962:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+21:15718:x1875839921828608:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 1014us (1259us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788940909.034971:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 11 00000020:00080000:3.0:1788940909.034976:0:17153:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788940909.043619:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940909.043766:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921828736 00000100:00100000:3.0:1788940909.043777:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921828736 00000100:00100000:3.0:1788940909.043841:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:3.0:1788940909.043852:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+21:15717:x1875839921828736:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:3.0:1788940909.043877:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940909.043926:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badea7d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc77bc expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.043963:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badea84 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.043995:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badea84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.044008:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badea84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.044122:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936800/0x9c34acc08badea7d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77bc expref: 23 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.044139:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badea84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77bc expref: 22 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.044148:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:3.0:1788940909.044151:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788940909.044155:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936a00, rc 0) 00000100:00100000:3.0:1788940909.044226:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+22:15717:x1875839921828736:12345-192.168.202.25@tcp:101:dd.0 Request processed in 377us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940909.044234:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:0.0:1788940909.265711:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940909.265764:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940909.265936:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921828864 00000100:00100000:2.0:1788940909.265952:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921828864 00000100:00100000:2.0:1788940909.266035:0:18674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921828992 00000100:00100000:2.0:1788940909.266040:0:18674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921828992 00000100:00100000:2.0:1788940909.266062:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:2.0:1788940909.266072:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+8:2406:x1875839921828864:12345-192.168.202.25@tcp:4:dd.0 00002000:00010000:2.0:1788940909.266135:0:18674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aa1126d, atime: 0x6aa1126c, ctime: 0x6aa1126d, blocks: 0x0 00010000:00010000:2.0:1788940909.266161:0:18674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc0d6101/0x9c34acc08badea8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.266187:0:18674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1788940909.266192:0:18674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940909.266199:0:18674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc0d6101/0x9c34acc08badea8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.266216:0:18674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc0d6101/0x9c34acc08badea8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.468648:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788940909.470899:0:18664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1788940909.470932:0:18664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:3.0:1788940909.480647:0:18674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:3.0:1788940909.480665:0:18674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:3.0:1788940909.480694:0:18674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc0d6101/0x9c34acc08badea8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.480760:0:18674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc0d6101/0x9c34acc08badea8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.480770:0:18674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc0d6101/0x9c34acc08badea8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.480778:0:18674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1600 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788940909.480786:0:18674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc0d6101/0x9c34acc08badea8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.480798:0:18674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc0d6101/0x9c34acc08badea8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.480831:0:18674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc0d6101/0x9c34acc08badea8b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940909.480841:0:18674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc0d6101/0x9c34acc08badea8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940909.481309:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+6:2406:x1875839921828864:12345-192.168.202.25@tcp:4:dd.0 Request processed in 215226us (215598us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788940909.481323:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:2.0:1788940909.481383:0:18674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:2.0:1788940909.481397:0:18674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2406:x1875839921828992:12345-192.168.202.25@tcp:4:dd.0 00002000:00010000:2.0:1788940909.481462:0:18674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6aa1126d, atime: 0x6aa1126c, ctime: 0x6aa1126d, blocks: 0x2000 00010000:00010000:2.0:1788940909.481470:0:18674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c6ea421/0x9c34acc08badea92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.481485:0:18674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1788940909.481490:0:18674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940909.481497:0:18674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c6ea421/0x9c34acc08badea92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940909.481527:0:18674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c6ea421/0x9c34acc08badea92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940909.604358:0:18664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1788940909.604695:0:18674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1788940909.604702:0:18674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1788940909.604727:0:18674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c6ea421/0x9c34acc08badea92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940909.604743:0:18674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c6ea421/0x9c34acc08badea92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940909.604754:0:18674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c6ea421/0x9c34acc08badea92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940909.604762:0:18674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0c00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788940909.604768:0:18674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c6ea421/0x9c34acc08badea92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940909.604780:0:18674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c6ea421/0x9c34acc08badea92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940909.604808:0:18674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c6ea421/0x9c34acc08badea92 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940909.604817:0:18674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c6ea421/0x9c34acc08badea92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940909.604992:0:18674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2406:x1875839921828992:12345-192.168.202.25@tcp:4:dd.0 Request processed in 123591us (339218us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788940909.605029:0:18674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 1 00010000:00010000:1.0:1788940910.494944:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940910.749465:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08c0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944990080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940910.749563:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940910.749621:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940910.749628:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944990208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940910.749657:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940910.749701:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944990080 00000100:00100000:0.0:1788940910.749711:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944990080 00000100:00100000:0.0:1788940910.749781:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788940910.749792:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944990080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788940910.749833:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788940910.749887:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944990080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940910.749895:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788940910.749925:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944990208 00000100:00100000:0.0:1788940910.749929:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944990208 00000100:00100000:0.0:1788940910.749953:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788940910.749961:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944990208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788940910.749991:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788940910.750024:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944990208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940910.750030:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788940910.750052:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940910.750098:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944990208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940910.750116:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08c0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944990080:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940910.750328:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940910.750342:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944990336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788940910.750380:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940910.750416:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944990336 00000100:00100000:3.0:1788940910.750420:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944990336 00000100:00100000:3.0:1788940910.750449:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788940910.750457:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944990336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788940910.750490:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788940910.750529:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944990336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940910.750536:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788940910.750567:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d034758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944990336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940910.891720:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940910.891778:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940910.891826:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940910.891851:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940910.891875:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940910.891902:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940910.891923:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940910.891943:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940910.891967:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940910.895481:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921829120 00000100:00100000:3.0:1788940910.895504:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921829120 00000100:00100000:3.0:1788940910.895623:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 168 00000100:00100000:3.0:1788940910.895637:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:2407:x1875839921829120:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940910.895752:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:2407:x1875839921829120:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 117us (4048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940910.895761:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 168 00000100:00100000:3.0:1788940910.895815:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921829376 00000100:00100000:3.0:1788940910.895820:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921829376 00000100:00100000:3.0:1788940910.895859:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921829888 00000100:00100000:3.0:1788940910.895862:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921829888 00000100:00100000:3.0:1788940910.895880:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921829248 00000100:00100000:3.0:1788940910.895884:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921829248 00000100:00100000:3.0:1788940910.895896:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921829760 00000100:00100000:3.0:1788940910.895899:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921829760 00000100:00100000:3.0:1788940910.895914:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:3.0:1788940910.895922:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2407:x1875839921829376:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940910.895957:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2407:x1875839921829376:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 36us (4180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940910.895964:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:3.0:1788940910.895976:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:3.0:1788940910.896001:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2407:x1875839921829888:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940910.896048:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2407:x1875839921829888:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 47us (4196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940910.896056:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:3.0:1788940910.896069:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:3.0:1788940910.896076:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+22:2407:x1875839921829248:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940910.896109:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+22:2407:x1875839921829248:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 33us (4207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940910.896116:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:3.0:1788940910.896128:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 68 00000100:00100000:3.0:1788940910.896134:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2407:x1875839921829760:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940910.896173:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2407:x1875839921829760:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 39us (4229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940910.896180:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 68 00000100:00080000:3.0:1788940910.896427:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940910.896432:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788940910.896829:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921829632 00000100:00100000:1.0:1788940910.896838:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921829632 00000100:00100000:1.0:1788940910.896894:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921830144 00000100:00100000:1.0:1788940910.896898:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921830144 00000100:00100000:1.0:1788940910.896913:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921829504 00000100:00100000:1.0:1788940910.896916:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921829504 00000100:00100000:1.0:1788940910.896932:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921830016 00000100:00100000:1.0:1788940910.896935:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921830016 00000100:00100000:1.0:1788940910.896953:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:1.0:1788940910.896961:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2407:x1875839921829632:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940910.897042:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2407:x1875839921829632:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 81us (5215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940910.897049:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:1.0:1788940910.897065:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:1.0:1788940910.897072:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0012ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2407:x1875839921830144:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940910.897096:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0012ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2407:x1875839921830144:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 26us (5221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940910.897103:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:1.0:1788940910.897114:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:1.0:1788940910.897120:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2407:x1875839921829504:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940910.897146:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2407:x1875839921829504:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (5223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940910.897163:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:1.0:1788940910.897176:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:1.0:1788940910.897182:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf086c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2407:x1875839921830016:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788940910.897204:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf086c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2407:x1875839921830016:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 23us (5238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940910.897225:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00080000:3.0:1788940910.898987:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940910.899000:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788940911.516949:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940911.580946:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1788940911.664636:0:20339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788940912.541512:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940912.798481:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940912.798515:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944990464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788940912.798621:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940912.798747:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944990464 00000100:00100000:1.0:1788940912.798759:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944990464 00000100:00100000:1.0:1788940912.798844:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788940912.798857:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944990464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788940912.798898:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788940912.799008:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944990464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 153us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940912.799017:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788940912.799495:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940912.801503:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf09678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944990592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940912.801605:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940912.801681:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944990592 00000100:00100000:1.0:1788940912.801690:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944990592 00000100:00100000:1.0:1788940912.801757:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788940912.801770:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf09678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944990592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940912.801799:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788940912.801851:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf09678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944990592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940912.801859:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788940912.801931:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf09678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944990592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940912.805644:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0967a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944990976:0@lo:400:kworker.0 00000100:00100000:1.0:1788940912.805729:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf09678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:303c4994-a6d4-4c7c-823f-eb7dad50725e:3646:1875839944990720:0@lo:400:kworker.0 00000100:00100000:3.0:1788940912.805753:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940912.805812:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf09679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944991488:0@lo:400:kworker.0 00000100:00100000:3.0:1788940912.805844:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940912.805901:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944990464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940912.805932:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0967a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944990848:0@lo:400:kworker.0 00000100:00100000:2.0:1788940912.805966:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940912.805998:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf09679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944991360:0@lo:400:kworker.0 00000100:00100000:2.0:1788940912.806019:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940912.806037:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0967ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944991872:0@lo:400:kworker.0 00000100:00100000:2.0:1788940912.806075:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944990848 00000100:00100000:2.0:1788940912.806084:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944990848 00000100:00100000:2.0:1788940912.806154:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788940912.806165:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944990848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940912.806234:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944990848:12345-0@lo:400:kworker.0 Request processed in 70us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940912.806242:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788940912.806290:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944990976 00000100:00100000:2.0:1788940912.806294:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944990976 00000100:00100000:2.0:1788940912.806327:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944991360 00000100:00100000:2.0:1788940912.806330:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944991360 00000100:00100000:2.0:1788940912.806353:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788940912.806359:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944990976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940912.806434:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944990976:12345-0@lo:400:kworker.0 Request processed in 74us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940912.806441:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788940912.806456:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788940912.806463:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944991360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940912.806491:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944991360:12345-0@lo:400:kworker.0 Request processed in 29us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940912.806496:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788940912.806548:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940912.806553:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940912.806573:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944991488 00000100:00100000:2.0:1788940912.806577:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944991488 00000100:00100000:2.0:1788940912.806607:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788940912.806613:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d034758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944991488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940912.806644:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d034758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839944991488:12345-0@lo:400:kworker.0 Request processed in 32us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940912.806650:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788940912.806823:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940912.806873:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf09678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944991232:0@lo:400:kworker.0 00000100:00100000:1.0:1788940912.806908:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940912.806931:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0967b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839944991744:0@lo:400:kworker.0 00000100:00100000:1.0:1788940912.806965:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944991232 00000100:00100000:1.0:1788940912.806968:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944991232 00000100:00100000:1.0:1788940912.806998:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788940912.807006:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0967bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944991232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940912.807047:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0967bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944991232:12345-0@lo:400:kworker.0 Request processed in 42us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940912.807054:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788940912.807080:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0967b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944991104:0@lo:400:kworker.0 00000100:00100000:3.0:1788940912.807248:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf09679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839944991488:0@lo:400:kworker.0 00000100:00100000:3.0:1788940912.807297:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf09679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944992000:0@lo:400:kworker.0 00000100:00100000:3.0:1788940912.807329:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940912.807357:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1788940912.807364:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d0065d1880, transno 8589934596 00000004:00080000:3.0:1788940912.807380:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1788940912.807402:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0967a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944990976:0@lo:400:kworker.0 00000100:00100000:2.0:1788940912.807406:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944990720 00000100:00100000:2.0:1788940912.807413:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944990720 00000100:00100000:3.0:1788940912.807431:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944992000 00000100:00100000:3.0:1788940912.807437:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944992000 00000100:00100000:2.0:1788940912.807454:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788940912.807464:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3646:x1875839944990720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940912.807485:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788940912.807497:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944992000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940912.807506:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3646:x1875839944990720:12345-0@lo:400:kworker.0 Request processed in 43us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940912.807513:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788940912.807560:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839944992000:12345-0@lo:400:kworker.0 Request processed in 67us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940912.807567:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788940912.807591:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940912.807634:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf09678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:303c4994-a6d4-4c7c-823f-eb7dad50725e:3646:1875839944990720:0@lo:400:kworker.0 00000100:00100000:3.0:1788940912.807646:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf09678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944991232:0@lo:400:kworker.0 00010000:00080000:3.0:1788940912.807672:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf09679880 x1875839944992000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940912.807683:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf09679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839944992000:0@lo:400:kworker.0 00000100:00100000:3.0:1788940912.807718:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940912.807751:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0967a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944990848:0@lo:400:kworker.0 00000100:00100000:3.0:1788940912.807779:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf09679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944991360:0@lo:400:kworker.0 00000100:00100000:3.0:1788940912.807806:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944991744 00000100:00100000:3.0:1788940912.807818:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944991744 00000100:00100000:3.0:1788940912.807842:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944991872 00000100:00100000:3.0:1788940912.807844:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944991872 00000100:00100000:3.0:1788940912.807863:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788940912.807869:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839944991744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940912.807907:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839944991744:12345-0@lo:400:kworker.0 Request processed in 39us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940912.807914:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788940912.807926:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788940912.807931:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944991872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940912.807965:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944991872:12345-0@lo:400:kworker.0 Request processed in 33us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940912.807971:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1788940912.807993:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940912.807997:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788940912.808017:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf0967b480 x1875839944991744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940912.808028:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0967b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839944991744:0@lo:400:kworker.0 00000100:00100000:3.0:1788940912.808052:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0967ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944991872:0@lo:400:kworker.0 00000100:00100000:1.0:1788940912.809433:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940912.809490:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf09679f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944991616:0@lo:400:kworker.0 00000100:00100000:1.0:1788940912.809553:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940912.809762:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944991104 00000100:00100000:3.0:1788940912.809775:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944991104 00000100:00100000:3.0:1788940912.809900:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944991616 00000100:00100000:3.0:1788940912.809905:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944991616 00000100:00100000:3.0:1788940912.809949:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788940912.809959:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf09679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944991104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940912.810035:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf09679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839944991104:12345-0@lo:400:kworker.0 Request processed in 78us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940912.810066:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788940912.810087:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788940912.810094:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf09678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944991616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940912.810130:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf09678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944991616:12345-0@lo:400:kworker.0 Request processed in 38us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940912.810150:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788940912.810180:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940912.810236:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0967b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839944991104:0@lo:400:kworker.0 00000100:00100000:3.0:1788940912.810251:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf09679f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944991616:0@lo:400:kworker.0 00010000:00010000:1.0:1788940913.563806:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 44727 lines, 44727 kept, 0 dropped, 0 bad.